EU trade - time for it to happen

We can see the evidence everywhere that coming out of the EU has hurt Britain and specifically British pockets, (and those who pushed for Brexit are saying the pain will be felt for another 20 years) so why isnt there more desire by Labour to rejoin? They seem determined to lean to the far right rather than do what's needed for everyday people.