Continuing to Apply while accepting Associate Position?

I’m in the process of applying for Junior Associate positions. I have an offer from a firm that I’m not really interested in. Start date will be in August. I’m just wondering what are people’s thoughts on accepting a job offer and then continuing to look in the meantime? I know it looks bad on my part but how bad does it look and what are the consequences?