Lack of Variety of Players

I play a lot, when I say a lot I mean a lot but anyways I'm like top 20 but I always see the same guys over and over its quite annoying honestly when I say same people I mean one time it was 1 guy for 2 hours. Is there a way for the matchmaking to notice how much you've played the opponent then just save me and him the time?