I (31/f) don’t know how to feel after this guy (38/m) pushed my hand away but was later affectionate?

I (31/f) don’t know how to feel after this guy (38/m) pushed my hand away but was later affectionate?

Why was he affectionate toward me after he did this?

I am kind of seeing this guy I have known for almost a year. We have hung out a few times.

Yesterday he was driving us to go look at something. While he was driving we held hands. I ended up kissing him on the cheek. He kind of laughed and pushed my hand away. I was kind of hurt that he didn’t want to hold my hand anymore but I didn’t say anything.

Later on we saw a really cool rainbow and we stopped to look at it and watch the sunset. He put his head on mine and we kissed a couple times.

TL;DR - I’m just confused and don’t know how to feel.