Play non-steam game through proton in steam vr?

I recently found out that on itch.io and other sites there are lots of free vr games/demos that I'd like to play. I tried adding one of those games to steam and launching it through steamvr with proton enabled, but it results in the game running inside a window, and nothing showing up in VR. Do you know how to do this?