Control a light bulb with both Alexa and a dimmer switch at the same time

Hello!
I currently have an Alexa connected to my light bulb (it's a white-only one).

Now, I also got a dimmer switch, which I wanted to connect to the light bulb as well, so I can either turn the light on/off with Alexa or the dimmer switch.

However, when I directly connect the switch to the bulb (by holding it up close and pressing the power button for a few seconds), Alexa can't control the light anymore.

I also tried connecting the switch to Alexa (there is a switch option in the app where you can also select Philips Hue, but I wasn't successful with that as well.

Is it possible to have that bulb connected to both the Alexa and the switch at the same time (without a Hue bridge, that wouldn't be worth it for just one light)?
If it doesn't work, I can luckily still send the switch back.

Thanks!