Ruining someone with rep

So I have a few antagonistic players who are out to get my character due to them being scum barge scum and anarchy is funny to them. Is there a way I can set in motion something that would ruin their criminal rep or any of the others? I'm talking to the point where no one would associate themselves with them anymore.