Possible bad 3080?

Hi everybody, I was lucky enough to get a 3080 (camped out for hours at a microcenter) and since then have had stability issues (massive frametime spikes sometimes from 11ms up to 50ms and sometimes all the way to 200ms+).

My specs are as follows:

CPU: 9900k

RAM: 32GB GSkill flare x 3200 cl14

MOBO: z390 Aorus Master Bios F11l (I tried older bios revisions F9/F10 as well)

GPU: Asus Tuf OC 3080 (Driver 460.79)

PSU: Corsair HXi 850W

OS drive: Samsung 960 Evo nvme

Other storage: Samsung 850 evo 250Gb, Samsung 860 evo 1TB, WD Black 4TB HDD

Windows: 20H2

Nvidia driver: 460.79 (tried multiple from before and current, same issues) Updated all chipset drivers from mobo website

Cpu and gpu are not overclocked, only xmp on the ram is enabled. Previously had the 9900k overclocked but for testing I have put it stock.

The spikes/stutter are noticeable in practically every title. I first noticed it just playing Valorant, but I also see it in RDR2, cyberpunk, modern warfare, and more.

Looking at MSi Afterburner charts the FPS is great, but the frametime graph is not smooth. I had a 1080 before and Valorant definitely did not exhibit these issues.

What I have tried:

-Removed all overclocks (including XMP)

-Clean installed windows with only the nvme drive connected

-used DDU to go to older drivers (456.71, 456.55 and more)

I am at a loss. My temps are great max 62C and benchmarks looks about right. Maybe my psu is bad now? But I would be surprised. My only other guess is the motherboard is bad or the card is. If anyone can help I really appreciate it. Thank you!

Links to clips of the stuttering in red dead and modern warfare. Valorant has been hit or miss with the stuttering:

Modern Warfare: https://youtu.be/hS6gJ642G7o

Red Dead: https://youtu.be/KJTsESCKFr8