Why is it seen as respectful to take off your hat?

This has apparently been a thing for a very long time since Vlad The Impaler famously nailed a man’s turban to his head because he refused to take it off, so where did it come from? What is the significance of seeing the top of someone’s head in order to show respect?