Switching between IR lasers/flashlights and visible lasers/flashlights

I've been having an issue where I can't switch between my IR light or my visible light when using a rifle that has a PEQ or really any IR device. I cannot reliably switch between visible light and IR light. I've tried changing my key bindings, but I've had to literally spam the button just to switch to the other one and most of the time that does not work. The bind is set to hold, but holding does not work. I'm at the point where I just do not run any IR devices because they do not reliably work for me in the game. Anybody else having the same issue? I see tons of players running IR so maybe they don't have the same issue.