I am by no means a thoroughly experienced rider, I have ridden a couple of stallions in fairly controlled conditions. That being said, it is a dangerous habit he is forming, stallion or not. If you are unable to turn him around and ride him in the opposite direction, spin him, and recoup some sense of calm -Stallion aside, the horse needs someone with a firm hand who can demand his respect. When we ride, we demand that our horses be able to ride back to the barn on a loose rein at a dog walk to cool down -if they don't do that, they get tuned up.
Have you tried turning him around and riding him in the opposite direction until he calms repeatedly until he can walk back?
Another thing, do you have mares at your property? I know a stallion can be urgent to get home and be tough for even the most experienced of riders if there are mares around. My mother in law has a great little stud, he is a wonderful, gentle horse, but put mares around, even in stalls outside the arena and he can be extremely difficult and shes been riding for 45 years