Can’t get to the drifter in Renegades expansion

I just collected the 3 ghost parts and now it wants me to go talk to the drifter but the path to get to him is blocked. Anyone seen this issue?