Horse is showing you the holes in training more than likely.
Cold, dinner and energy level all contributed to this, as well as you may only now be seeing the real horse.
And yes, he DID get away with not having to work, as he did what he wanted, and running around was not working to him. He got you off, he won.
I don't know anything in depth about you/horse or situation, but I would suggest getting a trainer, if you don't already have one, go back to some basics, and see if your feed is making him too hot as it might be.
I also wonder if you haven't been overhorsed, and are just now going to be seeing the real horse. But really bad for horse to have unloaded you, as he will not forget it.
And if you are doing any babying of horse? Stop it.
Horses make me a better person.