I would be happy that you have a trainer who recognizes the need to lay off. There are a lot of people out there who would not only take your money, but work your horse so hard that he's not rideable by the age of 10 due to arthritis, etc.
I once worked a crop of colts for a well-known saddlebred trainer named Forrest Gibson. The saddlebred colt was midway through his second year. He would walk and trot, but really had no desire. After I rode him for Mr. Gibson and the horse's owner, Gib said "Jack, you take this horse and you give him a year off...his heart just ain't in it yet" ...so that's what we did. The horse now has regional championship titles and is 6 this year.
I would leave him there, and try to gain as much understanding as I could about his "mental" and physical progression during the next few months...who knows - by spring you could be looking at a horse that has 90 days under saddle