How do you deal with former opposing leaders?

I'm new to this game. What do you usually do to counts of counties you have captured? Assuming they're part of your culture and religion. It seems strange to leave someone who just fought against you in power, and possibly dangerous. I suppose it just depends on how much they dislike you afterwards.