Yikes. That is just an accident waiting to happen. Hores falls, child still attached to saddle? Doesn't take a genius to work that out.
The only time I think this would be acceptable is in the situation vivache suggested, with sidewalkers at a slow pace on a reliable horse.
What is the world coming to?