Is New West as bad as people say it is?

I always hear people talk about how New West is pretty much a dump. Drugged out losers and homeless people everywhere, it's dirty, etc. But is this actually true?

I am going to Douglas in a month and have decided not to drive and just take the Skytrain so I don't have to deal with the God-awful traffic or anyone scratching, denting, (Or worse), breaking into my car.

It seems like it has good amenities like Safeway, Landmark, LA Fitness (I think), the boardwalk, skytrain right there (I suppose this just invites the losers from the DTES and such to come in, as will Surrey and Langley in the coming years), cool restaurants and some niche stores.

I know to stay away from alleys like any other big city (NYC, Vancouver and Moscow to name a few of the worst). I have also heard to not go near Columbia Street after dusk but that Queen's Park is pretty safe.

Does anybody else have any advice for me?

Thanks.