Flat easy terrain, more places on the trail to open it up and make up time. Usually easy footing, and the longer legged horses go faster at same gaits.
Rugged steep terrain usually involves rocks and bad footing, shorter more nimble horses do better. Lot less places on the trail where the longer strides can come into play.
As I mentioned earlier there is also the bone elongation factor over distance that must be considered.