Why do most people only wear gloves in the coldest weather but wear closed-toe shoes and socks except when it's very warm?

Shouldn't bare toes/feet and bare fingers/hands be able to endure the same temperature ranges? Is it only cultural that I can be comfortable gloveless in 40 degrees F but think my feet would be frozen in sandals at that temperature?