Why do men prefer much younger women as they age?

I was just reading an article about how men as they age generally prefer women who are in their early 20's regardless of their own age, while women prefer someone close to their own age. Is there an explanation to this that doesn't sound misogynistic?