Do controllers not work with mobile?

I tried to connect a remote I got that is supposed to act like an xbox remote, but all of the buttons only act like they're touching the screen as if they were my fingers instead of how a controller should act. Is there no way to configure or fix it?

Samsung galaxy s24 ultra + z01x controller for reference