How do you feel/respond when someone tells you, “You look tired”

First time poster from southern US. This isn't really a gay-specific question, but I prefer gay-centered responses

So this really bothers me. Whenever someone says, “You look tired,” I find it insulting - to me, you are telling that person they do not look good, for whatever reason. 

I hear it a lot and I get pissed. And not just from fellow gays, I get it from straight people too.

This happened tonight at restaurant with friends. We all finished up and as we were leaving, a not long-term friend, more a recent acquaintance newish friend says (in a kind of aww so sad way) “You look tired.”

In the parking lot, I mentioned to my husband how it ticked me off and he poo-pooed it, “it wasn’t malicious.”

For context I will add that my husband (62M) is very traditionally "gay attractive" and has never been told anything remotely similar, so I don't think he can relate at all.

I disagree. It's hard enough to feel attractive at 60, so it really hurts my feelings. I bite my tongue when I really want to pop off at them. I’ve tried the “it’s just my face” but that doesn’t quite land satisfactorily. So is it insulting or am I wrong/petty/overly sensitive? What do I say when someone says that?