How can I appear less gay?

I dont have any issue with gay people, but im not gay and ive been ridiculed for it, friends think I am secretly gay and it can be awkward and annoying sometimes. I think its because my only sibling and also friend in the neighborhood were both girls. I have the valley accent as a man. Or is this something i have no choice over and I am just how I am and accept it.