Thanks for everything you've said jillybean! I don't have any interest in competitve trail. It's nothing like endurance riding. I just want to ride for hours with my best friend (my horse), win or lose it doesn't really matter to me. Of course I would be fine placing in the top 10. :) I know it takes time to condition, but I'm not expecting to go out and have him do a 50m. I know he wouldn't be able to do that. I am totally fine sticking with the LD rides. That seems like something we could do with some conditioning work, no problem. He just loves to trail ride. If we were just trail riding he could do it all day (at a walk). He is so level headed and always wants to please. We get alone great, so I would never want to use another horse even if its a better breed. I do have a Arab/QH or a TB/QH, we don't know for sure because she was a rescue and has no papers. She has great energy, but she sweats so much, is a little unsure on her feet, and I just don't trust her enough yet. So even though everything else other then my horse would be better, I wouldn't trade him for the world.
As for having them lay down so you can go to the bathroom, that's funny!! :)