In legal hiring....

how bad does it look if I do not use my most recent employer as a reference? Would employers automatically assume there was an issue? I have other references to use but the most recent firm ultimately was not the right fit for me due to the level of micromanagement and differences in work style.