Adapalene Help

Hey everyone! I've been using an Adapalene 0.1%- Benzoyl Peroxide 2.5% combo gel that was prescribed to me for several months, and it's severely drying me out. Before, I used to have very oily skin, and now I see white flakes and rub off tons of dead skin with my fingers every day.

At first I thought this was just normal and starting applying it over moisturizer every day (only taking breaks when my skin seemed sensitive that day) but looking here, I realize I should have easied my way in. It's been 3 months and the reduction of my acne has been incredible, but I'm just getting tired of this persistent dryness and occasional irritation. Any advice on how to restart my routine? Should I cut my usage down to once/twice a week or every other day? Any advice is helpful!

Extra info: I use no other actives, use a gentle cleanser (Cerave Hydrating Cream to Foam), apply a hyularonic acid serum, my gel moisturizer (still a bit oily nonetheless!) and then adapalene. Same in the mornings except I replace the adapalene with Good Molecules Discoloration serum (tranexamic acid and 4% niacinamide).