How are you positioning yourself in relationship to his body?
When he comes in towards you, try walking towards his hind quarters and flicking the whip directly at his quarters, wave you arms, growl at him etc if you have to, just get his feet moving in the direction you want him to go.