Computer wont boot when GPU is installed

My computer randomly shut off when playing some games with friends. After an hour of fiddling i decided to take the GPU out and it started immediately. I then shut it down and put the GPU back in and its back to square one.

I have a feeling my GPU is done, but i figured i'd post here so i can get a second opinion on this before i buy a new GPU

I don't have a second system that i could test the card with atm, but from what i've observed so far i have a pretty strong feeling its the GPU failing.

Current specs:

i9-9900k

Aorus Z-390 motherboard

32gb of G-Skill memory

RTX 2080S (not anymore i guess)

Samsung 970 Evo