AIO someone i’m seeing appeared to have an attitude with me after i declined kissing them…

so i’ve (F22) been seeing this person for about a month, and we haven’t really done anything physical. when we first started dating, i lightly spoke about how physical intimacy is something that i struggle with. one night, as i was leaving their place, they asked to kiss me and i basically said no because i wasn’t really feeling it at that moment. the next night we went to a party, and they seemed to be really distant and brisk toward me. like the whole time its almost like they didn’t want to be around me, or seem like a couple. we went to play a drinking game in a garage a little later. after a full round, i left to go find their roommate because i haven’t seen her in awhile, leaving my purse in the garage. when they came back, they only had their purse (and mine was right next to theirs in the garage). they left my purse behind!!! once we went back to their place, we ate some food and their roommate went to bed. before i left i wanted to explain more about my physical intimacy issues, but it seemed that they didn’t care to talk about it. their face looked like they were irritated that i even brought it up. i feel like they totally switched up on me after i said no that kiss, which i think is weird af. am i being weird about this?