Train viewing around Durham?

Was wondering if anyone had any suggestions on train crossings or bridges in the Durham region (or surrounding regions) where I can take my young son to see trains for the first time.

Looking a crossing that:

1. is legal and safe to stand with a stroller and view passing trains where I'm not trespassing but close enough where he can appreciate the roar of the train.
2. I'm able to park legally nearby not blocking traffic (don't mind walking a short distance).
3. Isn't too busy at all as far as car traffic (Wilson Rd and Thornton Rd in Oshawa is way too busy). Looking for a rural area.

We already tried going to the wooden railroad crossing in Port Hope area on Lakeshore and didn't feel comfortable pushing a stroller over that little bridge and the busy track isn't very visible from there. And down the road to the East where the 3 tracks cross again was too busy with car traffic and no where to really park.

Thanks in advance for any suggestions!