If so, that might be the reason he's always on edge.
Also, maybe its his feed?
I'v been given the ride on many thoroughbreds, raced and unraced. Some were stone mad, and others were like lazy riding school ponies!
It really depends on the horses frame of mind, and personality.