I don't think it goes just with the weight of the horse or the height. Some horses are better built to carry weight than others. It isn't the legs that take the brunt of the weight but the back. Long weak backs do not carry weight like short strong ones. TB are tall but never designed or bred to carry weight. Ponies are short and have been carrying around heavy loads for centuries.