How do you push yourselves out of your comfort zone?

Due to the nature of my work, I spend most of my day reading dense academic texts and writing research manuscripts. So, when it comes to reading for myself, I usually avoid books that demand too much mental effort or are heavy on symbolism and references.

It’s awful, really.
I’ve been an avid reader all my life, but in past 5-6 years reading has become purely escapism for me.
I don’t mean that I read trash, I have good taste in literature. But there are at least 50 books like Ulysses that I’ve been meaning to read for years, and I just can’t muster the mental energy for them. The fact that English isn't my first language doesn't help either.

I feel like I'm missing out on so much. Have any of you guys been in a similar boat? I would really appreciate your advice.