You stopped by to pet a random horse? I wouldn't suggest doing that. I know some owners can be pretty anal when it comes to strangers coming up to their horses. Especially is they're young or hard to handle.
Also have to say try to avoid random horse visits unless you know the horse; you never know what kind of behavioral issues a horse may have, or how the owner may feel about it...better safe than sorry. :)