Feel like a complete weirdo, any advice welcome

I'm 26, I've been on T for 4 years now, pass 100% of the time. Today I had a coworker (M) pat me on the shoulder bc I gave him some advice. I flinched, it legit was the first time another person had physically touched me in years. I felt really bad ofc, I like the guy, we're friends. It was a weird af reaction that i wish i didnt have. But I've become someone who is pretty detached from others physically. I haven't found the strength to pursue dating since I came out. (I like women, not applicable here. Just saying romantic relationships provide that physical touch) I lost many of my friends at the time I started transition and have had to build my life now on my own pretty much by myself. I'm really good at being alone, dealing with my problems alone, but I also deeply desire connection with others and this weird interaction today made me realize just how much this solitary environment has effected me. I have friends that talk about our emotions, but those guys aren't the type to give hugs or more than a handshake and I think it's caused me to have this extremely weird reaction. I would love to start dating again but i have a ton of hangups about my own body, maybe that needs working on. What would u do in this situation, any advice helps