Brier Whale Watching

I’ll be in Halifax for the lacrosse nationals next week. One thing we’d like to do is whale watching. Brier Island as come up as a place to go but it’s 4 hours from Halifax. Could this be done as a day trip, if we left at 730-8 am? (there is a trip at 130 pm….). How is the drive out there and back from Halifax?