Bachelor degree vs graduate school

So I am looking to pursue biostatistics. I wanted to know what would be better: a bachelor degree in biostatistics from a private school, or a math degree from a public school and graduate school afterwards. I have managed to get a full-ride for the public university where I would receive a math degree. I am leaning towards that. Would the extra school be beneficial?