I agree with the previouse comments, everything will become smoother and much more effortless over time. Work on relaxing and moving with the rythm of the horse in a natural way. Once you have better strength and balance im confident your hands will become softer and steadier, just do your best not to use the reigns for balance or get stiff as you build on those points, its impossible to move naturally with your horse if your body is all tensed up. And keep that leg on in the canter your pony looked a little sluggish. Its looking really good, keep up the great work and you'll see tons of results!