Feeling gaslit into thinking I'm not nonbinary

This is mainly just a vent. I'm 26 and AFAB, I feel like nobody around me understands how I feel or respects my identity to the point where I've gone back in the closet. For instance over the years my family and friends have made comments about non-binary people, saying things like it's a phase or trend, it's just a step towards fully transitioning (like becoming a binary trans man or woman that kinda thing). I've had people say they'd never date a non-binary person and that using they/them pronouns is too exhausting and difficult for them to use. So I literally just gave us a while back and went back to she/her. I also feel stressed and anxious and am starting to gaslight myself into thinking I'm imagining things and that I am just a cis woman or the other way round that I'm a trans man in denial and even that it's all in my head and how I feel isn't real. Overall, I just feel sad and shitty. I was wondering if this is a common experience.