Season 6 Episode 16 drought conditions, Did Toby hook up with Senator Rafferty?

They tease in their discussion at the bar during the flash forward how they "rushed into this" and how she "is special " and they made it feel like maybe they had some sort of romantic relationship. We find out later that Toby fed her the health care speech which caused the fight between Toby and Josh and we assume that's what they were talking about at the bar but because the writers made it feel like they hooked up, I wonder if both can't be true.