Baby hates me

My 4 month old doesn’t calm down with me. In fact he gets more cranky when he comes to me. He hates taking my breast in the day. It’s only in the night that he takes breast milk. My husband can calm him down in a minute after i have made him cry trying to calm him down. I dont know why he hates me but he does. He doesn’t need me at all. He can go days without looking at my face and still be ok. I play with him, sing to him, bathe him, change his clothes and diaper but when it comes to making him sleep or making him to stop crying, he just hates me from all his heart. I just feel so useless. I dont know may be i dont give a good vibe but i love him so much and he absolutely hates being with me sometimes.