If it continues to do it without being repremanded, then its "learned bad behavior" because it has learned this behavior is acceptable.
A lead mare will not tolerate this sort of behavior, and if they are the lead mare in their barn (which they should be), they shouldn't tolerate it either. A lead mare would bite a little foal like that. You don't come straight out the womb and be a boss in 24 hours. This little guy needs to learn that this behavior is punishable (a lead mare would bite and shoo him off) and humans are no exception.
On a side note, I love how the "I can and will move you wherever I want to put you" has a celebrity name to it, like it was an original idea. When I was a kid, we used to call it "basic training".