Weird FPS mouse-related drop bug, looking for suggestions

First of all I play on a laptop that should run this game with no issues related to graphics (Ryzen 7 processor, RTX 4050, 16 Gb RAM) and I use a G305 Logitech wireless mouse. Basically, whenever I look around without pressing any buttons on the mouse I get heavy fps drops (even down to 20 fps), but as soon as I press any mouse button and keep holding it (even side buttons), the framerate stabilizes (130 fps on average). I already tried adjusting in-game Vsync, raw input, graphics and full screen settings, but to no use. Any suggestions?