Xbox Controller Disconnects When Using Mouse and Keyboard – Game Forces Restart

When I play using mouse and keyboard, my Xbox controller disconnects. Even if I turn it back on, the message on the screen keeps telling me to reconnect the controller.

Because of that, I have to completely close and reopen the game for it to work again.

Does anyone know how to fix this?