Social Anxiety and Office Hours

I personally love the idea of office hours and I do want to utilize as many opportunities possible to talk with professors. However, for actual in-person office hours, I can barely bring myself to the door, much less walk in. And I have tried multiple times these past few weeks but I always find myself hesitating at the door. I have spoken with this prof before, I even booked online meetings with him that went well. I know there logically isn’t anything to fear, but I still cannot bring myself to walk in.

Any tips or advice would be greatly appreciated. Thanks.