Both uphill and downhill imply something negative when used metaphorically. i.e. "It's all downhill from here" or "it's an uphill struggle"