Workshop progress bar is stuck

I claimed some workshop to farm fusion cores and someone came to conquest my workshop I was stronger than them but they wouldn't stop coming back to fight and I had to go AFK for a little bit so I let them take the workshop and then I tried to take it back, however the progress bar doesn't move at all??? There is nobody in the workshop and I can't figure out what's stopping me from getting my workshop back