kicking out at you is expressing his irritation that you are interrupting him in doing what he wants. His attitude stinks.
My thinking is that you need to interrupt a bit more. Such that you knock him right out of thinking on other things, and get him thinking on you!
Yes, he may jump, may buck or kick out, but he better go forward when asked and he better stop when asked and he better keep his eyes on you .
Don't be afraid to startle your horse if they are blowing you off and looking elsewhere. If they were paying attention where they should have been, they would not be startled in the first place.
BE important! More important that whatever he's looking at out there. If he has an opinion on it, meh, let him. Just be sure he moves out when you say, and stops when you say, even if he doesn't like it.
Gotta shake up his world a bit.