I messed up!

So, playing on xbox, i started the base questline and hired the overseer, then decided I'd rather put off building a base for a while. I deleted the base and built his terminal on board my freighter before doing any tasks for him, and now when I go to speak to him at the terminal my only option is to leave him to his work... When I select the quest it tries to send me back to the system where I'd originally started even though there's nothing there anymore...