Setting boundaries

Ok so long story kinda short - I don’t get along great with my husband’s family. There has been things that happened in the past that caused issues more specifically between me and my husband’s brother and his wife. We don’t get along, never have.

Since I’ve gotten pregnant, my husband’s brother has been pushing to see us more, have us over etc etc. I’ve told my husband I don’t have any interest. I’m not saying I’m going to keep the baby away once he’s born, I want him to have family in his life, and they’ll certainly be invited to baptism, bday parties all that stuff and I’ll be civil but the relationship he’s trying to push is not one I’m interested in. I am not wanting to have them so involved in my life right now, especially after how I was treated in the past. My husband keeps pushing it, and I don’t know how else to be nice about this.

I will also say, although I don’t have the best relationship with his mom, she is offering to help us with the baby which we really need, and I’m nervous if I keep pushing away a relationship with his brother it will cause issues, which I guess selfishly I don’t want. Does anyone have advice on how to deal? Do I just suck it up and spend time with them? Do I draw a solid line now before my baby is here?