Did the White Walkers pose a threat to Essos?

In the episode where they brought a wight to Cersei they said this would be the fate of every person in the world. But that episode they also said they can't swim. So they would just take over Westeros right? Was that line just hyperbole?​