Men of a mature age: If you don't perform very well the first time with a lady...

I'm 32 and recently had a DAILY text/phone relationship with a 49 yr. old man. Planned on a real date/encounter after months of texting and talking.
He was honest about his concerns about "pressure to perform with a 32 yr. old" We got together. (He lives far away and flew out to see me). Blast of a time on our date. Went back to his hotel. Drunkenly hooked up. We did not do too well the first couple of times. Neither of us finished. Next morning I initiated, sucked him off till he got super hard and asked him to try again. He did and I came. Then I could tell he was struggling to keep it up while using a condom, so I told him to "come here" and I took it off and finished him orally. He came like crazy.
The rest of the morning was sweet, although a little awkward and fuzzy. He left town that evening and I have only heard from him twice since, and only after I've texted or called first. (in 2 weeks) He is super busy but I feel like he is blowing me off. I don't get it because we get on like crazy and I don't care about his problem in the bedroom. WTF? Is he just embarrassed you think? That's all I can think of. What should I do now?