Going through pedestrian red lights

Just got honked the shit out of me for waiting 3 seconds at the pedestrian red lights because no one else was crossing anymore.

So i was just wondering do you guys wait for pedestrian red light turn green or as soon as there's no one you just go ahead?

If you dont wait,why?