Weird request?

Hi all, lived in Toronto a long time ago so I'm familiar with the city but obviously a lot has changed.

Staying in Richmond Hill, but I'm looking to take my 6yo kid through the downtown area. Some places I'm thinking are:

Day 1: ROM, UofT, Chinatown

Day 2: AGO, Eaton Centre, City Hall

Day 3: Harborfront, Centre Island, CN tower

I know this sounds impossible but one thing I'm trying to minimize as much as I can is driving through traffic. I know TTC is an option but I think from where I'm staying, that also comes with a really long ride...

I would really appreciate your opinions on where can I strategically drive down, park, and walk around and/or take TTC minimally? Also, am I missing anything in terms of place to go?