Why do I get panic attacks when I try to sleep in a new location without my parents around?

I've gotten to the point where if they're not at home and I am the only one that is it's not a big deal. Like they can go away for the night and I'd be completely fine with it.

Bit if I am to try to sleep somewhere else without them around it's an issue.

I'm starting to wonder if it could be because not only am I in a new location but I also don't know anyone at all in that location, and way too much has changed in my surroundings at once for me to be comfortable with, as well as there is no one around that I know and trust. Like I wonder if I were to stay with someone I knew, like a friend, I would be better off. I used to struggle with sleepovers as a kid, but I never actually had any true friends that I actually trusted back then either. Now I do, so I wonder if things would be a different story if I tried staying with them for a night.

I mean I'm 20 and a half I should be able to sleep away from home even a lot of my autistic friends that I feel like I have a very similar amount of function as (being more high functioning I mean) can do this seemingly just fine.