If my ex wanted to suddenly start sleepovers again, would I have to let him - despite him barely having a relationship with his daughter?

So the story is we went from 50/50 parenting and it gradually went down to him only video calling once a month for 15 mins (while on call with other people, so attention wasnt on our daughter) OR a possible 2 min visit at our front door (even though I would always invite in).

We have been separated since she was just over 1, she's now turning 4 this year. For the last, maybe 2 years? He's had very minimal contact with her - completely his choice, nothing has been court ordered as the one time I tried reaching out to a solicitor they told me to sort an agreement out between ourselves. I decided to just let things run it's course and see where things led to.

We have just now moved all of her stuff out of her dads house because he's making room for a family member to move in. Now her only space at her dad's, all her clothes, toys, books have been moved from his down to mine, like she's properly moved out, yet he's still saying things "when she starts sleeping over again..." - she won't have a space up there anymore, he says she'd sleep in his room and I'd assume he'd sleep on the fold out since he's never bed shared with her.

My question is, since he barely knows her and she barely knows him - like today she completely ignored him when we were saying goodbye - if he started asking for sleepovers as of like, tomorrow or next week, would I be obliged to just...let her go to them? Or would I have the option to tell him to build a relationship with her first and see how she feels?