Can not get my CPU fan to stay the same RPM while gaming.

After gaming for a bit, my CPU's heatsink fan increases its RPM about +1000 RPM when my CPU temp gets around 60c. Whether I start gaming with the CPU fan set to 2500, 3000 or 3500 RPM, it always boosts itself a thousand more when there's a lot going on in the game - when starting a game at 100% fan RPM (3500) it eventually goes up to 4500 RPM, from 2500 to 3500, etc.

I've tried applicable BIOS settings, SpeedFan and MSI's utility ControlCenter (from my MSI mobo) and none of these methods allow me to play a game (Fallout 4 right now) while keeping the CPU fan speed at the same RPM the whole time I play.

Is this normal? Both my system fans maintain the same RPM the whole time I play. While I'm sure the increase in my CPU's fan is a safety measure, I should be able to override this somehow? Any help's appreciated.

Btw I use both HWMonitor and HWinfo64 to monitor the fan's RPMs just to make sure it's not a read error (plus I can hear the fan get louder as I play)