Decreased appetite suppression

Feeling disheartened as my appetite suppression has reduced and food noise is coming back. I’m on week 1 of 5mg (after 4 weeks of 2.5mg). Weeks 1 and 2 were amazing, week 3 was alright but I feel weeks 4 and 5 have been a downhill slope. I have had roughly 3 days a week off plan for the past 2-3 weeks now. I know dieting and calorie counting is essential regardless of weight loss medication but keeping to my goals was incredibly easy with strong appetite suppression. My problem now is the constant thoughts of food and feelings of hunger are coming back and it’s getting harder and harder to stick to it. I am wondering if anyone else has experienced this and it got better further on in their journey.