PC not booting on the first try

Hi everyone! I'm new here, been enjoying the forum and now i'd like some help from you with a problem.

I upgraded my PC on Black Friday (new RAM, motherboard and GPU), but after the upgrade it started having issues.

Before the upgrade everything was fine with the startup.
I was on an A320M with 24GB RAM (1x8 and 1x16).
I moved to a B550M with 32GB RAM (2x8 and 1x16).

Now every time it boots I need to turn it off at the power supply and turn it back on again. On this second try it starts normally. This even happens when restarting, I still have do the TURN ON → FORCE SHUTDOWN → TURN ON process every single time for it to actually boot.

The fans, GPU and CPU LEDs all turn on normally, but the buzzer beep doesn’t play like it should during a proper startup.

I formatted the system trying to fix it, went from Windows 10 on a SATA SSD to Windows 11 on an NVMe M.2, but nothing changed.

I also changed some boot priority options in the BIOS but that didn’t work either.

My setup for context:
B550M
RX 6600XT 8GB
Ryzen 5 3500X
32GB RAM
1TB HDD – 1TB NVMe SSD (w11) – 250GB SATA SSD

I wanted to see if anyone has had this problem or can give me a hand with it. I couldn’t find anything useful in my searches