Pacifier falling out

My 6 week old uses a pacifier to fall asleep most days and I’ve been working on taking it out as she’s asleep during naps in the hopes that she learns to stay asleep without it… The past few days she’s been struggling so badly to sleep in general and while napping in the carrier she’ll turn her face making the pacifier fall out and that’ll wake her up. The broken sleep is leading her to be so overtired!! Am I doing her a disservice of letting her sleep with one? Is there some tricks I’m missing?