It makes me so mad that i can't even date go for a 4 year age gap even though we both are legally adults

So I'm actually still 18 but turning 19 this year and the guy I'm dating is already 23 and I'm so mad cause society doesn't approve of this age gap not even my peers do. They say that this guy is trying to 'take advantage of me' and 'praying on me'. Like why can't my friends just be happy for once that I've found an admirer. But NO! They're just seeing the age gap and not the love.