Why do guys like me better now that I dress worse?

I have seen this answered before in relation to women and dating, however I am a man and I just mean guys trying to be friends or just engaging in idle chit chat.

I’m really interested in fashion and up keep of my appearance but I always would get bullied or stared at for it, even to the extend that guys I know said they were embarrassed to be around me.

I started dressing worse and looking more unkept to not be noticed and have less comments and stares. But this seems to have back fired and have the completely opposite effect of a lot more men being friendly to me and actively trying to be mates.

I know this is no stupid questions but I feel like this is some common sense I’m missing, I am genuinely so confused by this ?