Femcel hooked up with an Incel

2 weeks ago I hooked up with an incel. He said it had been 3 years since he last had sex. I like him a lot but now he keeps talking about moving close to me (we live 1.5 hours apart), making plans 6 months from now and wants to go with me every time I go to a concert, casino etc. And we aren't even officially a couple. I've known him for about 2 months now so it's just too soon. I'm getting vibes that he's kinda desperate to keep me so he isn't lonely. He works from home and has no life outside of work and never leaves the house and told me that I've been his only reason to go out and do something fun. I do like him but idk how to keep him in my life without feeling constantly smothered or hurting his feelings. I told him my concerns a couple days ago and we haven't talked since but I miss him.