[Free will skeptics who don't believe in moral responsibility] On selectiveness

Is a poor man who steals for food not to blame, and is a rich man who steal from the poor also not to blame?

I can easily expand this to ideologies you strongly disagree with. E.g. Israel/Palestine.

Many examples used by free will skeptics (esp. Sapolsky) seem to be more based on political analysis and ideology. Politics is completely fine - but it is basically judgement (and Sapolsky attacks conservatives). But I fail to see the connection with causality or free will. That the poor man could be less blameworthy (depending on situation) is a compatibilist analysis.

Do you actually believe that people you strongly disagree with politically are also not morally responsible or blameworthy? Can you live that view? Is it fair to ask that you do?