Am I being too pushy/impatient?

We’ve been talking since 3/5 and I brought up the idea of meeting this weekend for breakfast or lunch, whatever sounds good to him. He said yes he loves food. So I said ok great what would sound good and then the subject gets dropped or changed or better yet hours go by before I get a response. I know he is interested because we still text and flirt but it’s so low key I really have no idea what’s going on. My past experiences have been that by now the guy wants to meet for drinks or dinner and we start dating or decide not to. So I’m wondering if it’s me...? Am I asking to meet too soon and maybe he isn’t ready? Should I just leave it alone and wait for him to decide when we should meet in person? It’s not like we live far from each other. He lives 20 minutes away.

UPDATE: I didn’t text him again for the rest of the day. I waited for him to respond and text me back. He did...two days later!