White robed elder?

I'm right before the point of no return before entering chapter 4 and I don't think I've been doing the white robed elder quest which I apparently need for a secret boss fight... Can I still do it or have I been locked out? Can anyone help? I know I'm supposed to find him in various locations and I can't remember when the last time I spoke to him was if at all.