At what point do you realize a fight is about luck and not skill

Okay so I got this game at launch and so far i think i am getting pretty good at it, i've had some wins and some losses. But during some of those matches I noticed me and my opponent were of similar skill level so my question is at what point do you think a match comes down to luck.