yes it would be great if you could join him up at a local riding school. If you took up riding too it would be a great help to him, but even if you didn't, you could be just as helpful by encouraging him from the ground.
Leasing a pony may be an option for you sometime in the future - that way if its just not working, you know that you don't have the huge responsibility of fiding a new home for the pony.
Someone at a local riding school or barn may be able to give you some ideas of whats available in your local community.
When I bestride him, I soar, I am a hawk: he trots the air; the earth sings when he touches it; the basest horn of his hoof is more musical than the pipe of Hermes. ~William Shakespeare