Waiting for everyone to get to 4-way stops

I can't stand when I'm approaching a 4-way stop, and from like a block away, the only car at the intersection is already fully stopped, but instead of going, they wait for me to get to the intersection and come to a stop before they go.

Like why did you wait to make me wait instead of going so I can go?!?!