Why don't we replace the Supreme Court with Referendums?

The reason I ask, is because it seems a bit insane that a small group of old codgers can decide landmark legal precedents for the most powerful nation on Earth.