Brawler’s Guild Queue

Why does my position in queue keep going up? I’ll be at 8th in queue, then suddenly it’ll jump to 10, and then it keeps doing that. This turns what should be a ~20 minute wait into a 45 minute wait.