Series X Controller Issues

I am not sure if this is a known issue or not, but nothing came up on my search so...

I found that m Elite 2s (tried several) button presses are not registering properly. I have to press every button several times before the action is taken. It makes the game unplayable for me. is this an issue? and if so is there a fix?