Have the Supreme Court Justices always had a political affiliation, or is that just a symptom of today's dramatic polarization of politics?

The way that Chief Justice Rogers was completely disowned by the Republican party made me think about the pressure that each Justice must feel to vote in favor of their party's interests. It seems that this may compromise their ability to be truthful about their interpretation of the law.