AITAH For telling my boyfriend it's not my job to wake him up?

I (33f) have been with my (47m) boyfriend for 3 months and he stay at my apartment every other week (when I don't have my children I don't involve them in my relationships until I'm sure it's going to be a long term thing) but he sleeps ALL day and doesn't have a night shift job he just stays up all night and sleeps all day. I have brought it up to him a month ago about how I couldn't be in a long term relationship with someone who sleeps like this. That we never spend time together on days off because of his sleep schedule. He showed for about a week and a half that he was trying to change it (I know it takes time and doesn't just change over night) but for about a week an some I haven't seen him making any effort to get up earlier or go to bed sooner. Well yesterday I was leaving for work and he hadn't even gone to sleep yet and asked him if he was going to get up an go to work and he said maybe that he was tired. I told him if he would sleep at night he wouldn't be so tired and he said I kept him up with the tv being on.. this is the first he has said anything about the tv being a bother. I need the tv to sleep it is my apartment and he doesn't contribute to my place at all. So I feel a little aggravated about this. But today he woke up and 2pm 30min before I had to leave. And when I told him I'm fixing to leave he said I could have woke him up so we could spend some time together I told him it wasn't my job to wake him up and that I wasn't his mama. He was quite for a while and then said I was right. But I'm feeling like what I said was kinda assholeish. So am I the a**hole?