I had a coffee date

It started out by me going to the wrong coffee shop, 20 blocks away from the one he was at. I text and said I would come to his but he was already on his way to my location. I had already bought a coffee so I could save a table. We had a nice conversation for an hour and a half. But he never ordered anything. He just sat there while I drank my ice coffee. We are both in our 60’s. Was I supposed to ask him what he wanted and buy it for him? Was I rude? It just never occurred to me.