RE REQUIEM PATH TRACING ISSUES on 5070

I built my PC a week ago, the only game i tried with Path Tracing is Requiem, i know it does impact performance a lot but i saw this guy's video with a 9600X and a 5070 and he's getting ~3.5X My fps, i have an Ultra 7 265K and 5070, don't seem to have an issue on other games, it's very weird weird because if i just use my RT High, High settings it would run at high fps for some minutes and then it starts going to 20 fps again even without Path Tracing, i've done stress tests and it's definitely not thermals.