AIO for withdrawing my in-laws access to my child?

For starters-thank you anyone willing to give advice because this has been racking my brain morally for a long time.

So I am a 23f FTM and my fiancé is a 27m & I’ve had issues with his family since before we had our kid tbh. And my fiancé hasn’t been always there to defend me & stand up for me with them either and that’s why our issues have carried on for almost the whole time him & I have been together. They act like it’s okay to say or do something disrespectful & when I’m outwardly upset about it and try to communicate my frustration-I’m the problematic one. I’ve been trying to forgive my MIL for telling me that I never should’ve dated her son and that he would never marry me and that I was the worst thing to have happened to him. And that’s only a few examples of the things I’ve endured without my fiancé’s support.

Now, I say that to say-my daughter is only 17 months right now & there’s been multiple times that I’ve let her grandmother (my MIL) watch her-and something inappropriate happened. For one example: my MIL had her new boyfriend spending the night around my daughter before me or my fiancé even got to meet him. Also, her aunt had her boyfriend meet my child before I did. And was smoking while she was there! Both of those adult men meeting and being around my child when I’m not there and I don’t even know their names makes me super uncomfortable and it’s even scarier that I didn’t find out about it until she was already there.

For added context-my own family isn’t involved in my life at all (traumatic childhood & foster care lol) but her dad, my fiancé had a pretty relevant relationship with his family before I started having issues with the way they treated me. And he is really upset that a lot of his closest family doesn’t like me. It sometimes bothers me and I feel bad because I wonder if I’m making the right choice for our daughter…

I told them that the only way they could see my daughter is if they met with all of us (specifically me) in public like a park or museum. Is this the fairest choice?