Do I care too much about what others think, or am I really just frustrated about not feeling understood?

I've always told myself that I don't need everyone to like me. And for the most part, I think that's true. I'm not looking for universal approval, and I don't expect everyone to understand me perfectly.

But what really gets under my skin is when people believe things about me that simply aren't true. It seems like I keep finding myself in situations where I'm being completely honest about something, yet people assume I'm lying, hiding something, being selfish, manipulative, or having some ulterior motive. Sometimes I'll explain my intentions as clearly as I can, only to realize the other person has already decided who I am and what I'm about.
The frustrating part isn't that they disagree with me. I can handle disagreement. It's that I feel unseen.

Then I start questioning myself: Why does this bother me so much? Is this just me caring too much about what other people think? Am I seeking validation? Or is it something different?

If I'm making a genuine effort to be honest, self-aware, and transparent, it feels disorienting when people project motives onto me that don't exist. It's almost like being falsely accused of something, even when the accusation is subtle.

I also wonder if other INFJs experience this. We spend so much time trying to understand other people's inner worlds that it can feel especially painful when people don't seem interested in understanding ours.
accurately.

Can anyone else relate to this distinction? How do you stop feeling frustrated when people insist on misunderstanding you?