Mt. Fuji day trip planning- visibility and Japan stat holiday

Hello!

I’ve been keeping an eye on Mt. Fuji visibility after we booked a day trip to go out north of the mountain. We initially booked for Nov 4 but the forecast is showing 10/10 visibility for Nov 3. I found out that Nov 3 is a holiday in Japan so I’m hesitant about trying to go that day because it might be super crowded with lots of traffic more than the usual.

Do you think it’s worth it to deal with the potential bigger crowds for the view? Or take a chance on a partially visible forecast for the day after? We only have Nov 3-5 as options for the day trip and Nov 5 is looking like the worst day out of the three for visibility. This is our first trip to Japan! Thoughts?