You do the exact same thing as I do, you are crooked because you turn your inside shoulder back, This makes your rein hand go off to the side as well instead just in front of you. As others have said, stop looking down. Half halt him a few times to round his back for you & give to the bridle. Just these few things & you 2 are perfect. Good to know someone else rides exactly like I do.