You can saddle him. Don't put the heaviest saddle you can find on him but we have a little synthetic saddle the babies can't hurt and we saddle the colts as yearlings and let them stand tied while we ride or let them wander around in the round pen every now and then. One less thing to worry about when they're two.
They can "be a horse" when they aren't doing their job. The best horses you'll ever find are used to all these things by the time they're started. I love turning them out and watching them play with the other horses but if for an hour a day a couple times a week I want them to have a saddle on while I work my mare, I think that's a reasonable expectation.