DAE feel like this about being invited anywhere?

It's like I need that people around me to be super specific and vocal about wanting me to be some place. Otherwise I'll just assume you don't want me there. Specially if I have to keep asking about directions to get to the place, an adress, an hour or some part of the plan that is important for me to know. Is this selfish or egocentric? I know other people's lives don't revolve around me but I hate feeling like they invited me because they didn't know how to say no