Maybe I said this a little to "harsh" sort to speak(?).
Abby - He's the type of horse that would really let me know by bucking, or swishing his tail...etc. I don't know where it is, I haven't really asked, since I only ride him once to twice a week (twice is MAX). I rode him on the trail only once, to build up muscle and again, to get him out. The trials are really good footing, too, since it's only a trail around the property - not rocks, just an easy going trail.
PoptartShop - I am really slow with him, and he's not "dead" lame at the end of the rides.
kim_angel - I think, again, that I maybe said "really lame" - I didn't mean super lame, just a tiny limp, and, it's after 20 minutes with a good walk, trot, canter (20 minutes after I walk of course). I always ride him on a loose rein.
northernmama - Yes. He walks and trots in his pasture. I'm sure he'd canter, but the footing isn't the best.
SonnyWimps - Yeah, I think he'd let me know and for now, he's fine. It's only when he gets super excited when he'll work harder. He always is super happy.
Sara - I don't take him on trails away from home, but sometimes (rarely) he'll go on light trails away from home. Again, the footing is really nice and it's a SUPER easy trail. No huge hills.
Harlee - After rides he's fine, he doesn't limp really.
Thank you so much everyone! I will keep this advice - I think it's really just a situation where you need to see him move.