Am I obligated to pay the initially agreed upon bicycle repairs?

Atlanta, Georgia. I recently dropped my bicycle off at a shop for a couple upgrades & a tune-up. They wrote up a work order/ estimate & said it would be ready in a few days. A week later I called for an update and they said they are still waiting on parts. Then 45 minutes later they called and said they ordered the wrong part ($12), and the correct part will be around $40. I am not happy that they didn't reach out to me with updates sooner, and instead I had to reach out to them. This is also suspicious because I have talked to many other bicyclists and the part should stay in the $10-20 range, not $40.

I also experienced/realized something personal that makes me uncomfortable to be a customer at the shop anymore. So the sooner I can finish my business with them, the better!

Am I able to "change my mind & pick my bike up" or do I need to let the shop add the upgrades as initially agreed upon and complete the tune-up and pay the full amount?

TLDR: I dropped my bicycle off at a local shop & agreed to upgrades and a tune-up. I change my mind, so can I pick it up without paying if they have not completed the services?