When to see a doctor for a zit in my ear?

It's been there for 3+ weeks now, hurts. I'm only concerned because of the proximity to the brain.

It doesn't seem to be getting bigger, but it's also not healing. It's in a spot where I can't see or reach it very well, right at the top. Several times a day it scabs over and the scabs are sharp and hurt.

Should I just keep waiting for it to heal? I know there's limited blood flow there due to all the cartilage. Just worried about infection spreading.