Affordable yet family friendly area?

My husband and I are loosely considering checking out Victoria for a possible move. We have an infant. When we visit, we'd like to stay in or near a neighborhood we might realistically live in. Good for kids and families, but not the most expensive. Where we currently live/can afford is among the least gentrified/second highest crime area of a rapidly gentrifying town.

What's Victoria's equivalent? Even here we have decently nice public schools, and are walkable to grocery stores and cafes & the local tiny neighborhood library.

I know there are similar posts but I also know these things can change fast based on our own neighborhood.

Thanks!