His paciness may very well have something to do with him being sore.
If he's dragging a hoof, he hurts somewhere.
Have a vet and/or an equine chiropractor examine him first; make sure he is sound then work on smoothing out his gait
TWH's cannot always gait properly when they hurt somewhere. It is not uncommon to see them trot under saddle, if something hurts