You're gut's most likely right. I had the exact opposite thing happen. I found a horse who, when I went to see him, didn't have a nice trot, was a bit too thin, and much younger than what I wanted, but he had a nice personality, a good mind as they call it. I left thinking I'd keep looking. For the next two weeks, my gut kept screaming at me to go get that horse. I ended up getting him and found myself with the best TB I could ever have hoped to find. He's just the sweetest boy in the world. Trust that gut! You'll do fine.
You just have to see your distance...you don't have to like it.