Disciple of Varashta Ascendancy (qol) game feedback

I was excited to play a plant build while using Kelari skills from the Varashta-Ascendancy on a second weapon set. However the game forces me to manually swap weapon sets which makes it feel a lot worse.
You can select a weapon set for the command skills but there seems to be no point in doing that since you dont generate the use-charges of the skills, once you deactivate it in one weapon set. In other words: you HAVE to have it active in both sets in order to continuously generate use-charges while switching in between the different skills you want to use.

I dont see why it should be this way and it really makes my experience / plan a lot worse and just feels bad. I would really like to NOT make my entire build a 2-button-build from start to finish but limitations like these make it harder to fulfill the vision of combo-gameplay imo.

(Sure I could just learn to manually swap but it really sucks here with short duration plants which I constantly want to refresh + im a casual noob player).

Thanks for reading. Keep up the good work.

The UI is a little weird indeed, u can Weapon Set the Djinn skill only if u RIGHT CLICK THE SKILL ON YOUR SKILL BAR, then ull be able to set that Command Skill to one WS only.
If u go to the skill gems menu, it disables the whole aura for the Djinn.
Also, it does not work for the first skill (the daggers for Kelari, for example).