What was your experience going off birth control?

I started birth control when I was 16 for acne and now I'm 23 and debating going off. Only thing is I'm terrified of my acne coming back again.