AIO: thinking about filing for divorce after my husband got in my face during a fight

Yesterday I told my (36f) husband (36m) I felt distant from him. I wasn't blaming either of us, our work schedules just aren't aligning and I miss him. We used to have sex 2-3 times a week, but lately it's been 2-3 times a month. And I've been initiating it. So I was in a quiet, reflective mood and I felt somewhat sad. I tried to enjoy our night and tell him what I needed, but sometimes when I tell him how I feel, he flips it to where HE is upset and then I have to help HIM feel better/calm down. So I kept it simple and he gave me a hug and a kiss while I watched TV and he played his video games.

I still felt the sadness and distance between us today because nothing really got resolved last night. He was frustrated with me and telling me he tried to hug and kiss me but I was quiet. Eventually it turned into him saying I was "being a mother fucker and sitting there like a dumbass not telling him how I felt."

I got up and said I'm gonna go to my mom's house because it wasn't getting better, and actually it kept escalating. I said I told him I don't want to be called names because it's verbally abusive and he said "Abusive? you want to call me verbally abusive?" and he walked at me but went to open the front door. Then he was telling me "you can leave with that shit" with our door wide open (I hope our neighbors didn't hear it). I grabbed out dog and left. My head was going crazy as I drove and I was so scared seeing the look on his face. He didn't touch me, but I felt scared and like I wanted to disappear so it didn't get to that point. I feel like I was trying to make things better all day, but nothing was working. IDK how it turned into all of this. AIO for leaving and thinking about filing for divorce over this?