Did I overreact to my doctor’s comments?

Today was first follicle scan after my third round of letrozole. The doctor was doing my scan and asked if I’d been tracking ovulation at home and at first I said no then I remembered I’ve been using my new Inito hormone monitor. I fumbled the explanation a little because I was nervous. He got impatient and the conversation got tangled and he said, “So how can you be tracking and not be tracking?”

So I apologized and said I just got confused and he goes,“It’s okay. We don’t trust our patients anyway.” I don’t know if he meant it as a joke. Nothing in the room told me, but it was just silent and awkward. He then told me the letrozole didn’t work this time I need to up my dose for 5 more days and come back in a week and walked out.

I got dressed and went to the nurses station to check out and immediately started bawling. The nurse was so gracious and kind, pulled me into a side room, and gave me a long hug. She apologized profusely and said it was uncalled for and even went as far to call him a misogynistic doctor and said he has a big ego.

Safe to say, I’m switching doctors. I do have a fear now that I’ll run into the doctor again or the other doctors at the clinic will see me as a “problem” now. Did I overreact? Should I switch clinics in general?