Throwing the head around and bucking into the canter could be signs of some kin of discomfort. Will he do this when you are not ON him? LIke in the round pen or paddock? Could be the saddle is pinching .
I agree with another poster that you might be over cueing, by kinda goosing him and leaning too far forward. Wathch him in the round pen and see how he breaks over into canter. Visualize that when you are on board, but first make sure the saddle is not a poor, painful fit.