I agree that starting and stopping is confusing. You might want to go back to the lunge while he's saddled and teach him the English for "right lead" and "left lead". It will translate when you are riding.
I've also watched Julie Goodnight's many programs that involve correct leads. She can get any horse to pick up the correct lead immediately by positioning the front foot forward, haunches at a 45 degree angle.