Dog only responds to an aggressive tone

My dog only responds when I use a highly aggressive tone which is far from ideal in public. Why is this and what can I do about it?