What advice would you give your daughter on how to look nice, but not attract too much attention from men?

I want to dress nicer but it seems like whenever I dress up I get unwanted attention. For example men following me in their cars. They won’t take no for an answer even if I tell them I am engaged. Is there a way to look nice and not look like I want attention. I am average looking,please advise