AIO to what I think my boyfriend is overreacting to?

My boyfriend (m33) and I (f33) have been together going on 5 years now.

When we first started seeing each other (just to get to the point) we had sex everyday. Multiple times a day if possible.

Would literally stop what we’re doing to meet up to have sex.

So fast forward , we decided to live together, btw I have 2 teenage daughters. They were 9 and 10 when I got with my boyfriend.

We were for a period of time homeless , staying from motel to motel just barely financially getting by. I started working graveyard so we honestly had little or any time together. We both became distant with each other arguing because of the stress and situation.

Sex literally stopped for months at a time.

Okay things are okay between us but then instantly go back down.

Let’s say one day we do be intimate, I’m good.

We hardly have sex anymore so it’s like okay that was amazing but back to life.

On the other hand he like will not stop at any cost be up my ass. I get it. It’s not a bad thing him wanting me. I’m actually happy my man wants me. But if we are running late or have to be at work or either take or pick up the kids from school. Like dude right now is not the time.

And he will go on a full on rage bait start accusing me of cheating, saying I’m just messing with his head and the list goes on.

Like wtf you think that behavior makes me want to. Cause if that’s how you act every single time I’m not in the mood then I don’t even want to deal with it.

I hope I made sense.