Moving from Beverly Hills

I’ve lived in Beverly Hills for many years but thinking of moving to OC for a change of pace… I can’t afford to live on the waterfront in Newport, and don’t care too much about views. What are some good neighborhoods that are luxury but maybe slightly less than Newport ? I have a baby and an older daughter for reference and we’re looking for a family friendly neighborhood