How TF do you de-aggro Oscar???

Trying to do the main quest on cursed mode. At the step where we need to listen out for the planet names, Oscar will not return back to search mode no matter how long we wait or how far we go