January or February

Me and my wife are planning an anniversary trip and want to see Quebec City. We understand it will be cold and will prepare for layering and wearing adequate winter gear. Is it worth it to weather the cold? Also, is march too late for winter season there? We want to see it during winter season.