How to deal with the negative perception of heathen symbols?

The flair is new to heathenry, but I've been covertly heathen for over 10 years now. I've picked up a few subtle heathen symbols (subtle mjolnir pendant I wear all the time, a couple of small runic tattoos) which are personally meaningful.

But I worry that people will see them, put them together with my white skin, beard and bald head, and assume "there's a nazi".

It keeps me from wearing the symbols of my faith with pride. It makes me self conscious in a pool. I want to honour the gods and feel I'm doing them a dishonour by hiding things away.

How do you handle this feeling?