CPU speed is all over the place at idle

I recently built my computer with a Ryzen 5 5600 cpu and I’ve noticed my cpu speed in task manager is fluctuating all over the place while it’s idle. Going from 3.7 GHz to 4.4 GHz and back down in seconds. I don’t know why it’s overclocked and I even reset my bios to factory setting and it didn’t fix it. I don’t want my cpu to be running at overclocked speed because it’s getting too hot. Anybody know how to fix this or is it normal? Thanks