Only prestiged players in duel?

I have no prestiged characters yet, my closest is lvl 14, but no matter what I get paired against prestiged players. how is that fair? Honestly I sound like a whiny bitch but I'm just kinda salty that the matchmaking does that. Are prestiged players all that play duels now? Already?