Steamdeck palace map question

I've been playing since launch on the steamdeck, I've noticed when im in mementos or the palace i can't open the map, or even really control it without using the touch screen or cursor mode. Am I missing a button combo or did the devs simply not consider controller players using the map?