Making people uncomfortable?

Wasn’t sure what to title this, but basically I’m very very new to carrying. My fiancé wants me to carry since we have a baby now and whenever I’m out and about by myself with our baby, he wants to know we are still protected. He got me a vertx everyday carry bag and I love it, it’s easy to use and doesn’t look any different than every other crossbody bag you see moms wearing. I’m still not completely comfortable carrying yet, I have a fear that it will put me in a more dangerous situation than if I weren’t, and I have a fear that it could somehow harm my baby on accident. He reassures me that those are irrational fears and I have nothing to worry about. I carried today for the first time going over to my parents house because I intended to run some errands while I was out, and it made my mom very uncomfortable. She doubted my ability to actually pull a firearm out on someone who was intending to harm me. It’s kinda making me question if I should continue to try to get comfortable carrying or if my anxieties around it are justified. Did anyone else have this problem when they first started carrying? I AM scared to go out by myself sometimes, especially with how crazy the world is, but my biggest fear is accidentally hurting my baby. And I feel like I’m in this weird position of wanting to make my fiancé comfortable with me being out by myself with the baby and making my mom comfortable with me carrying. Any advice would help.