Am I an asshole for prioritizing my sleep over my boyfriend?

Hello, I am in need of some help seeing both sides of a disagreement. My boyfriend (32 male) and me (26 female) are in a disagreement about sleep. Sometimes during the night my boyfriend will get aroused and dry hump me/feel me up while I am sleeping. I have told him I do not like it and want to sleep through the night. He says I am making him feel unwanted, like I want to sleep more than I want him. We typically have sex 2-5 times a week and the humping at night has happened if we have had sex before bed or not. Am I an asshole for prioritizing my sleep over my boyfriend? Thank you for any advice!