Sorry?

This morning my son, who is just staying to walk, slipped and took a tumble and started to cry because that's what toddlers do. He was wearing socks which makes walking a little challenging because we have laminate floors. My husband made a comment about how having socks on makes it hard to walk and the way he said it sounded like a poke at me since I was the one who put his socks on when getting ready for the day. In response I said sorry... That was it.

He then freaked out and started cussing saying that he can't say anything without me thinking it's an attack and stormed out of our son's room. I left to drop our boy off and then go to work without saying goodbye or anything.

The whole thing feels like an over reaction on his part, but it's not the first time he said I took something the wrong way. But I'm not sure how I'm supposed to take it with the way he talks sometimes. Is there something other than "sorry" I can say that doesn't sound like I'm being accusatory?