It's a yes or no question

Does anyone get this a lot when replying to a question?

I usually answer in a roundabout, indirect way. Usually I'm not comfortable answering in a binary yes or no, it is or it isn't, because the actual answer is more complex. Then I try to explain the conditions for a yes or a no, but it still comes down to a yes or no overall.

I also tend to lean towards neutral with words like probably or kind of. Maybe because I don't want to stick to one side when it risks criticism or the answer is complex. But then again my infirm response bothers people as well.