Busted (sort of) Weapon Swap on PS5

My Gemling monk has a bit of an issue with the weapon swap feature and binding.

I use 2 pillar of the caged god quarter staves. I would like to have a different aura setup (Blink with my attack speed pillar, Cast on shock with my 3 socket) But after binding weapon swap it simply doesn't work, as in the weapon will not swap. To test it, I switched one of the quarter staves out for a bow and it swapped without issue.

I have heard of some people just assigning a certain skill to one of the weapon sets, which I did attempt with hand of chayula, and it performed the hand of chayula, either without swapping or it switched back after performing the skill...unless it literally bypasses it because the quarterstaff itself isnt being used? Which I guess I could further check with another skill.

This is definitely something that's been noted right? I tried searching but didn't find many specific comments or threads that related to what ive experienced.

The only way ive foud to workaround right now is to just manually swap it and swap the auras. but if anyone else has had his issue and knows a way around it I would appreciate the advice.