Cannot Unspec Lord of the Wilds Keystone

Character name is WorldsBestDragon. Playing the Oracle ascendancy. Took Lord of the Wilds to see if I could have all of my spirit gems on with my new gear. I can't so I went to unspec it. I didn't take any nodes within its radius that wouldn't normally be possible without the Entwined Realities notable, nor do I currently have a scepter equipped. I can remove other keystones like mind over matter if I unspec the nodes that aren't attached to the tree.

Figured it out before I finished this. I unspecced the weapon set passives that were within it's radius before I could unspec Lord of the Wilds. Said passives were connected to the rest of the tree, so I'm assuming this is a bug.