I 24F believe that he 24m disregarded my request/boundaries over protection

I 24F have been in a fling with a guy 24M on and off recently and have known him since grade school. Since he came back to town, we’ve been seeing each other for sex. Last week I didn’t have a condom with me, so we did it unprotected and he pulled out before finishing (I’ve never told him I’ve been in birth control). There has only been two times where he has used a condom, and the first time we saw each other was also unprotected because he didn’t have one.
Yesterday we saw each other and he saw that I brought some and he said he didn’t want to use it since we didn’t last time. So we didn’t use it, but while I was down on him he got frustrated bc I wasn’t doing it right and told me that I couldn’t suck him, so we changed positions and he then pulled out and finished. After that I was very mad and annoyed at both things at once, that when he mentioned a song he was playing I only glanced at him and not said a word. He’s been the only guy I’ve ever been with sexually, and sometimes I feel like I have been holding onto him because he’s my only access to intimacy.
My question is, he texts me again, do I set my boundaries clear with him regarding protection or do I not answer at all? There has been multiple occasions where he doesn’t listen to me communicating what I want either, and I feel like this time he disrespected my boundaries even more.