I've never actually heard someone pronounce potato as potahto except for in that phrase.