Does being addressed as "ma'am" mean I look old?

I'm 24 and, until 1.5 years ago, I lived in a country with a different language. Here, in the States, I've been addressed as "ma'am" twice this month. Is it just respectful or does it mean those people think I'm an old/mature lady and it's time to change something?