Am I being unreasonable with my landscaper, or have I given him enough chances?

Looking for some impartial opinions because I’m getting really frustrated and don’t know if I’m overreacting.
I hired a landscaper for a backyard/front yard project and paid a $3,600 deposit. The total job is around $10,500.
Since starting, progress has been extremely slow. Most days he has only worked for around 2 hours before leaving. There have been repeated reasons for delays, including his car breaking down, supplier issues, and changes to the fence paint colour. Every time I ask for an update, I get another explanation and a new timeline.
The frustrating part is that many of the things he’s said would happen simply haven’t happened. For example:
Work days are often very short (around 2 hours).
The outdoor blinds have been delayed for almost two weeks.
The fence painting had to be redone after the original colour wasn’t right.
The fence installation and other landscaping work haven’t progressed as expected.
I find myself having to ask every day what the plan is.
This morning I simply asked:
“What time are you looking to start today?”
“What’s the plan today? Can you please chase up the outdoor blinds?”
His response started with:
“We just need to relax a tad… I’ve had no car and I’m doing my best…”
I understand things happen, and I’ve tried to be patient, but at this point I’ve lost confidence because the timelines keep changing and the progress doesn’t match what we’ve discussed.
I’m now considering removing the fence installation from his scope and getting another contractor to do it, or possibly ending the arrangement altogether if things don’t improve.
Am I being unreasonable, or would you also be losing confidence at this point?
If you’ve dealt with a similar situation, what would you do?