Were there any openly-abolitonist members of the Confederate government or military?

I have always assumed that, while slavery was the defining reason the South chose to seceed and fight a war, it very possible that there had to be some abolitionist movement in place somewhere in the South. But were there any actually in the government or military, or was it even legal to speak out against slavery in the CSA?