Static sound from PC getting into headphones

Hey guys, My headphones are either connected to my 3.5mm front jack or my USB Microphones on-board 3.5mm jack. Whenever GPU is under load, a static/buzz seems to play through the jack into my headphones. Have also noticed it cutting out my mic or making it quieter. Typical the higher the frames, the louder the buzz. Any ideas on what it could be? I figured at one point maybe coil whine, but I just don’t know if it causes interference like this. Thanks!