My (36F) best friend/coworker (33M) is giving mixed signals after we cuddled

Need some outside perspective: my (36F) best friend (33M) of more than 2 years and I recently cuddled a bit too intimately while watching a movie. His hand was caressing my back under my shirt, but still basically PG. But before anything could happen (we weren't even kissing) he pulled away and said we were getting too close, and he was starting to feel things. He said that of all the female friends in our group, I was the most special (he's very affectionate with everyone) and he's weary of developing feelings for me as we also work together. I left his house after that and we haven't talked about it since then. It's been 5 days but I feel like for the most part he's been avoiding me, even though other times it feels as if nothing happened.

I'm honestly very confused. If he really liked me like he said he did, wouldn't he have simply allowed things to happen that night? And wouldn't he try to clear things up asap so he can start seeing me as more than a friend?

Idk. It low key feels like he was just rejecting me gently. Thoughts?