Help with Attachment to just Dad

I’m at a loss and I don’t know what to do. It’s just getting worse. Ever since my 18 month old was about 13 months he’s been attached to my husband. Like inconsolably cries if my husband leaves the room. Makes it so hard for my husband because he works from home part of the week and can’t have our son screaming at the door while he’s trying to work. It ends up with us leaving the house or tv time but neither of those is realistically good. I feel like I’m not able to participate in being a mom because I can’t even be with my son since he doesn’t want to be with me. I’m worried I failed as a mom somehow. I had bad post partum depression and never wanted to hold him when he was a newborn and I’m scared this damaged our relationship. I always hear it’s temporary it’s because he feels safe with you but he truly does not want to be around me. I’m at my wits end. I feel constantly judged by others around me that I’m not parenting but it’s truly because I can’t. My husband really is the only one who can. My toddler would rather be around anyone else but me.