Performance issues

I’m having pretty extreme fps drops (155-50fps) when playing Oblivion Remastered. I’ve installed the script extender and the mod which boosts performance. I’m not adjusting the visual settings in-game because I know this can cause problems, yet I still have stutters and frame-drops. When freshly booting the game it’s a bit better, but when I go through a loading screen the fps drops to 25 and stays there. I’ve lowered the settings, even playing at 1080p which doesn’t resolve the issue. I have a Radeon 6600 GPU and a Ryzen 7600 CPU. Can anybody help me, or is it just a matter of waiting for a patch?