Are age gap relationships different depending on the genders, and sexuality?

I can be wrong and this could be observation bias. But I feel like society treats age gap relationships differently depending on whether the old partner is a man or a woman. Also, if it's a straight relationship. Like, if a 20-year-old is dating a 50-year-old, does it matter if the old party is a man or whether they are straight or not?