Any supplements to stop acne from dairy?

I've been a vegetarian for many years, so my food options are limited. On top of that I even stopped eating dairy about 2 years ago because I realized it's the reason for my chin acne..a couple of days ago I came home from a concert and I ate two sandwiches with cheese.. today I'm dealing with 4 fat cysts on my chin. I don't want to live like that anymore. I miss cheese. Is there anything I can take that lowers hormones which dairy stimulates? Things I already take: Zinc B12 MSM Lysine D3/k2 Iron Magnesium