Wants to upgrade PSU, have some concerns regarding other parts

Tldr; Bottlenecked on the PSU, wants to upgrade, but GPU starts acting up recently (no display when turning on sometimes, restarted itself when doing AMD's driver built-in recording). Will buying a new PSU fix it?

This is my INITIAL spec:

Msi b550 gaming gen 3 Ryzen 5 5600 Amd rx 580 16x2 3600mhz ddr4 Corsair CX650, the non modular one

Was planning at first to get a used 6700 xt so I bought a 650w. But instead got a great deal on 6800xt, the XFX Merc one, and so I had to make due with daisy chaining it on a 650w PSU.

In a few days I'm planning to get a new 850w modular gold PSU. But a few weeks back, my GPU started to do things. Sometimes when booting up, it doesn't show any display and the motherboard's lights for the GPU turned on. I also can't seem to game while using AMD driver's built-in game recorder, so I just outright disable it.

So I am wondering now: Will buying a new, better PSU solves my problem? Or should I maybe save up afor a new GPU or try to diagnose it more? I'm trying to be wise on how I spend my money. Thanks!