Dating Advice

So I recently met a man and he stated from the beginning that he is interested in pursuing me. We have been talking for about two weeks, and last night he asked me why I have not called him babe or baby yet which is something he has called me. I feel like it will come gradually as I get to know him more. My actual response to him was that I didn't think about calling him those words "baby" or anything. I sort of just met him and have only had one date. I could tell he pulled back some because of it. I know In the grand scheme of looking to potentially marry someone, this issue is so small but I just wanted some advice on what I could do moving forward. He told me likes reassurance, he is great man so far so I just wanted advice on how I could move forward. Thanks.