My horse, Sam, was TERRIFIED of whips - and to show his fear, he would get grumpy/aggressive about it - fear turns into aggression with most horses. Now, though, he lets me smack the ground with the string on my "handy stick" really close to his back legs, and his lungeing is getting better - in fact, he used to pin his ears when lunged, too, but he's gotten much better about lungeing as a whole (racehorses don't lunge alot, ya know, lol)...
It sounds like you're just a normal horse and normal rider, with occasional bad days just like the rest of us!
"Horses are proof that God wants us to enjoy life"
SAVE THE MUSTANGS!!!!