“Up to London”

I’m nearly finished a re-watch and keep noticing they say they’re going “up to London”. Does anyone have any reason why they would say “up” and not “down” when (geographically) London is south of Downton?