Prison Break Bug?

I'm playing regular Warband, just bought it during the Summer Sale. Every time I get a quest to rescue a prisoner from a castle, I get in, kill the prison guard to take his key, and then when I exit the prison no guards spawn and I can't actually leave. This only happens in castles, not towns. Is there a way to fix this?