Please help!

So, I have an irritation bump on my nostril piercing, and I genuinely have no clue what to do about it. I had one in the past that I tried leaving alone, merely cleaning it with saline, but it NEVER got better, and it got to a point where I had to remove the piercing so it could heal on it's own. I tried tea tree oil two days ago, and it worked pretty good, so I tried it again yesterday, but I think I just made it worse, as my irritation bump is bleeding a lot now. I really don't know what to do, and I really don't wanna have to take it out again, so any advice?​​​​​​