PC gpu issues and keeps crashing

So yesterday I was on my computer and all of a sudden on my right monitor it started artifacting, everything froze, and it crashed. Every time I'd reboot it it would freeze in the middle of reboot. I can boot it into safe mode (the windows 11 blue screen mode with some options on how to fix it).

Basically none of the options even let me try them. Eventually removed my GPU. Everything works now, I can go on google, use my settings, etc. Only issue is I obviously can't play games because I don't have a GPU.

So I bought a new GPU to see if that's the whole issue but the same thing happens. Works without GPU but freezes on boot with GPU. In the blue screen menu I can restore system restore, but I only have one option and it is from when I tried to update the drivers after all this happened (thinking it might just be a simple drivers issue.)

With system restore and GPU installed I can actually login to my pc but it crashes like seconds after i get to my desktop. One time I had about a minute and I noticed that it doesn't even recognize my GPU. I don't know where to go from here.

Any help is appreciated.