I’m Stuck on the Same Day for a Thousand Years

I want to know what happened to the protagonist's plan to destroy the family that tried to pursue the first girl. I'm already at the Princess of Morocco arc, but it feels like he completely forgot about the plan. The story introduces a new girl every chapter, so I'm wondering when that plan actually comes into play.