My lab/hound puppy doesn't want to be outside.

I just adopted a three month old black lab/hound mix. He will come outside with me to eliminate, but when I try to take him for walks around the paths near my complex or play with him in the dog areas, he'll just turn around and stare towards the door back inside.

He lost his mother at 3 weeks, I'm told. I don't know if that's relevant. Any thoughts on why my puppy might not like being outside? It is winter, but it's not super cold here in Atlanta.