Haute42 doesn't work in actual games in SF6 (Switch 2)

Have a weird problem with Haute42 controllers and Switch 2.

In the in game menus in SF6, the buttons all work fine but once I go into Training Mode (choosing Player 1 and Player 2 (CPU)) or when I actually get matched with a player in ranked the buttons stop working.

I tried 2 different Haute42 controllers and it's the same problem. The controllers are in Switch mode.

I could understand if the buttons didn't work at all even in the in game menu screens but why do they stop working?