My ex texts me I feel I should pull away

Our relationship was short lived romantically yet years later he still contacts me we chat all day about our past intimacy or basic life things and I've noticed that he's actually changed to be more of a him that I could love well I do love and I think it's a big problem that I'm taking steps backward but forwards with him ik the best thing is to pull away but I just can't do it