I thought “Twelve Hands High” referred to a very large horse, but in fact it’s a very small pony

Like, Shetland territory. That’s four feet. Minuscule. Why are they so afraid of this tiny, tiny horse?