Unintentionally confrontational

Does anybody else have extreme problems with coming off as confrontational when in reality you would consider yourself very peaceful/ avoiding conflict? I always feel so incredibly bad when something I say makes people feel attacked even tho I didn't mean it that way.I personally almost NEVER say something with the intention of creating conflict/ being mean. But I still often find myself in situations of conflict. And it's so frustrating, too, because why do I, the person who only "started this conflict" because I am convinced I am right 100%, have to give in and always be the bigger person. People always tell me I am the one who can't compromise yet I somehow always give in in these situations.

Anybody got advice on how to handle the guilt and extreme frustration I feel afterwards?