How did courier birds throughout history know where to go to deliver their attached message?

How did the men sending the birds trust them to successfully deliver a message to their desired recipient?

I've always wondered how the birds knew where to go and not to just fly off to freedom. It's not like they have a built in modern GPS system in their head giving them directions, so how did they know where to go?