He is completely disrespectful and ill-mannered.
Don't raise a whip toward him if you do not plan on leaving a welt -- several would be better at this point!
Quit threatening him and nagging him. When you only 'peck' at a horse, you usually just make them mean and more aggressive.
NEVER, NEVER, NEVER 'give ground' to a horse. Whatever he is doing when you back up a step is what you are teaching him to do. You need to learn to 'read a threat' from a horse. He already knows how to 'read a surrender' from you. He is in charge right now and he knows it.
Watching some Clinton Anderson DVDs may help you, but I really think you need an experienced person to work with you that can help you learn how to 'read' a horse and develop the timing and technique to establish respect (and do everything else).
It is not the amount of time you spend with a horse; It is the quality of the schooling time a person is giving that horse. I would rather have a person with skill spend 10 minutes with a horse than have a person that lacks feel, timing and skill spend any amount of time from 5 minutes to 5 years with any horse. The horse will only keep 'going down-hill' with the later. The more time they spend TRYING to work with a horse, the worse the horse will get.