In your mind, what are the downsides to not having children?

For a lot of people, being a parent is a life goal that one essentially feels called to. Others are very sure they don’t want to.

If someone is deciding, it’s pretty easy to see the upsides of both sides, but I’m wondering what is usually a downside of not having a kid in a fencesitter’s mind.