Can I take out jewellery with an irritation bump?

I’ve had my second lobes for a while I want to say over 2 years maybe even longer. I’ve always had issues with them since day 1 but I’ve got titanium jewellery (labret push pin) and use the neilmed saline spray twice a day. I’ve downsized but had to put the longer bar back in due to the bump.I have developed an irritation bump on one that will not go away no matter what, I have realised it’s because it’s pierced at an angle so the back of the jewellery is putting pressure on the top. I think I must have slept on it and that started the initial bump but I just can’t get rid of it. Can I just take it out and let it heal? I know you shouldn’t take it out if there’s an infection but I don’t think there is just irritation. Thanks for the help!