The trick is to push the button once and then start walking while the "Do Not Cross" sign is still red. All cross walks have a safety sensor built into them. That way, if someone starts walking early; it will switch the lights faster.

Try it sometime.