Not connected to my masculinity

Hi I'm gay, specifically femme. I've always accepted myself for who I am but sometimes I can't help hut get weird feelings of personal failure whenever I interact with (straight) men my age. It's weird because I love being gay I love being femme but maybe it's the environment I'm in that makes me a bit self conscious around masculine presenting str8 men. Can any of you relate? Why do I feel this way?