My personal theory has to do with him also having an Appy pattern. The breeder's stallion was grey and ALL of the grey foals that also had a pattern greyed out super fast. The ones that are characteristic, but without an actual pattern did not grey out as fast.
My other gelding Boots also greyed out super fast as well. I'll get some pics of him up as soon as I find them on my photobucket.