Punishment should be quick, effective, and appropriate for the action that causes it. It should never be out of frustration or anger, and should take place within the first 3 seconds. After that the horse can't connect the action and the punishment.
Those words. I really like Cherry Hill's approach to things. Especially the theories in "How to think like a Horse".