Septum hurts after changing jewelry

After having my septum for 2 years and I had taken the jewelry out for about a year. This past December I found out that the hole was still open, but it had shrunk so I went with a 20g horseshoe and after about a week of soreness, all was good. This Tuesday I decided to change the jewelry to an 18g 7mm clicker and it felt fine that night, but it started hurting on Wednesday and whenever I accidentally bump the jewelry it makes my eyes water. The weird thing is that most of the pain is felt on the left side of my nose, not so much on the other side.

The jewelry is good quality so could the pain be from the size change or the clicker being too tight? Should I give it a few more days before taking it out? Should I put the jewelry back in at all or should I just change it completely?