If you were building a civilization, would it be better to live with water on three sides (Florida-esque) or mountains on three sides?

What is more beneficial to an early society? Access to water and defense or ores and defense?

Does taking weather into account affect things? Typhoons vs Rock Slides…