Post "no trespassing signs" on every few sections of fence post. That ought to establish that people are not welcome, and if they get hurt, it's their problem for not following the clearly posted expectations. However, in some cases, horses are considered an "attractive nuisance", as in, they attract people to them even though they can be dangerous to those same idiot people :p
Not sure how that would pan out, I'd ask local law enforcement, to be sure