Party spends whole campaign trying to kill a guy

A while ago I read the story of a party who ended up working for a guy who they found out was making them do bad things. They could never catch him because the guy always had escape routes and would run as soon as he knew they were coming. In the end they have to use a Time Stop scroll to kill him and end up erasing him from existence.