I agree with everyone, you need to earn respect. However, I am not a believer in the "whoever moves the others feet is the boss", I work on the concept of a 50.5% (you) : 49.5% (horse) partnership. Maybe it depends on the circumstance, but I know for my mare who I have done a lot of groundwork with, asking her to move this way and move that the other way and back up and blah blah blah just for the sake of it frustrates her. A horse won't invest energy in doing something unless they see the point in it, it's in their nature to want to conserve energy for a time of NEED. (Of course if you are bullying him around, he will move out of fear).
You constantly nagging and pushing them around is the equivalent to an overly bossy leader who, if you observe herds, the other horses do not wish to interact with. There is that crazy alpha horse who chases horses away for no apparent reason (no feed, no danger, no other horses reacting to any situation) and the other horses simply move away in annoyance. They want to follow a calm and gentle leader, who will take lead to give them confidence but is not chasing, pushing, and annoying them.
Of course being too timid when your horse is kicking and biting can be dangerous, but to me it is about balance. I guess it depends how you want your relationship to develop but I would recommend some of Mark Rashid's stuff, his attitude on horse-human relationships really opens your eyes.
Also.. have you had him looked over by a vet? Just to be safe..