Gamepad Double Skill Use

In combat when multiple mobs are surrounding me, i attack/use skill one mob and if i flick any of the joysticks fast to change target to an enemy behind me for example , the attack/skill is cast again without pressing the attack/skill button .
Both the left one for auto target towards movement direction and right stick for manual aiming direction.