Need Help, less FPS after upgrade from 3060 ti to 9060XT

Hello, I recently upgraded my gpu (3060 ti) to a 9060XT 16gb.

I made sure to remove the old drivers and installed the new using the cachyos Wiki (switching NVIDIA to AMD)

I even deleted all the old Caches (starting from steam to all dcxv etc)

BUT My fps dropped like 20-40%

3060ti ran at 95-99% and 9060xt 100% at no frame cap.

The Settings are the same: Maxed out 1080p Native no upscaling.

I also noticed that FSR doesn’t seem to improve the fps (only in outlast trials)

The games tested: Overwatch, Outlast trials, where the winds meet, Palworld, High on life (only game where the fps are kinda the same/lowest drop of all games)

My system: Ryzen 7 5800X

Asus B450m-a ii

32gb ram

ReBAR was disabled in the 3060 ti but enabling it on the 9060 xt didn’t improve anything. (Yes Linux shows that ReBAR is active and 16gb)