Anyone experiencing drop to 30-40 fps for 4-5 seconds after playing for a while, then it goes back normal?

It does not happen very often, like once per 2-3h maybe? And I have 64GB OF ram so I doubt that might be the leak. Anyone experiencing that?

My gameplay various on 160-240 fps, but once per time this happens.