I really like him but I think I’m afraid of physical touch. What do I do?

I've liked someone this much in the past. He's so perfect in everything, attentive, polite, funny, intelligent, caring, hard-working, and very handsome. He's a nice guy. I really like his hugs. We've been on 3 dates so far, but I think I'm afraid of physical touch from him. I don't know why. I mean, I know. I have a pretty fucked up past and I can only have physical contact when I'm drinking. Because otherwise I'm afraid. Btw, I'm a 23-year-old woman with trauma. I don't drink with him, which is great. But how come it takes weeks or months to kiss him? How do I get over this? Is it normal to like someone so much?