So if you beat someone the whole set and they leave after they win once, who won the set?

This happens all the time and most of the time and its so silly rather than being annoying lol