Plex only works with remote access turned on. Feel like I'm missing something obvious!

I am trying to run a Plex server to play media from my PC to my TV. I use my PC as a plex server and access it via an app either on my Sony TV or my PS5. Neither the TV nor the PS5 can see the Plex server over the local network. It only works if I turn on "remote access" and then the I get a warning about "Indirect Access" and the speed/quality is not great. I feel like I'm missing something obvious with my network/server settings but I don't know what it is.

I tried the steps listed here and nothing has worked: https://support.plex.tv/articles/204604227-why-can-t-the-plex-app-find-or-connect-to-my-plex-media-server/

All devices are on the same subnet of the same network. No VPN. Server and app updated and both devices restarted and logged in and out. What am I missing?