Road trip with three-year-old in Charlevoix

We’re planning a summer road trip to Quebec City, Baie-St-Paul, and Tadoussac to see the whales. Our initial plan was to rent accommodations in all three places for a few days each.

Now we’re considering having a home base in Baie-St-Paul instead, doing activities around that area and driving to Tadoussac for a day trip. It seems like it might be easier with our toddler since it would mean less packing and fewer changes to her routine.

On the way back to Gatineau, we’d then spend a few nights in Quebec City.

Does this sound like a good plan? Has anyone used Baie-St-Paul as a base for exploring the area (including Tadoussac), especially with a toddler? She will be three in May and our trip is planned for the end of July.