What do you think of books where there is a subtext in the illustrations?

I'm thinking like the little critters books where the words tell a story, but the pictures change the meaning of that story?

Reason: I have a book that I'm starting into the illustration process for. The words are a back and forth between Grandma and her grandkids. They ask when they can do a certain thing involving her garden, and she answers, no, but they can do another thing.

I want the reader to feel a very warm bond between Grandma and grandkids, so I'm thinking of having my illustrator show them playing games or making cookies or something like that when they are asking questions, and then doing the things Grandma says they can do on the next page.

But would it be weird if a book about gardening with Grandma has them doing puzzles and paying catch every time the kids ask if the can help in the garden, before they go into the garden to do the thing?