How does Simon not get the references and callbacks?

I honestly envy him. My head is full of crap that I really don't need to remember and he seems happy to not get any of it.

I love that for him.