ALVR stability with Vision Pro

So I have a new M5, and I paired my PSVR2 controllers with it. I got ALVR working and played Half-life Alyx with it, but there seemes to be some stability issues. As it started loading the next level it basically crashed. It looked like I was partially in VR and partially not. Also I tried running Ghost Town in it, and just said it was loading, and would never load. When I looked at Steam on my computer, it still said Play on the game page, as if it wasn't even trying to load.

Both work fine on my Quest 3 with either Steam Link or Virtual Desktop. So Im guessing its an issue with ALVR. From what I understand, Steam Link on the AVP doesnt run VR games right? I wish it did, or that there was Virtual Desktop too. Anyone else have these issues with ALVR?