Does it matter which balance bike?

My kid will be ready for a balance bike in the spring. I see them from $40 up to $300. I know the more expensive ones have more features, but does it really matter which one we get?