Okay, forgive me for being blunt, but first of all, you need to get that torture device out of his mouth ASAP. If you can't have proper and light communication with your horse with a simple snaffle (nothing twisted, etc) then you have some big holes in your horse's foundation, and in the relationship.
The horse is obviously afraid and he's trying to get away. Pulling on BOTH reins WILL NOT help, in fact, it makes the situation worse. A horse who is obvioiusly fearful, and top that with now feeling claustrophobic and pain from the bit, and you have yourself a major accident waiting to happen, not to mention the horse's confidence in you is going down the drain. You need to use ONE REIN AT A TIME to get control of him, but NOT with the kind of bit you are using.
You need to ask yourself WHY he is exhibiting this behavior. It's not because he's being bad, stubborn, etc. or that he's acting stupid. He's afraid. Plain and simple. And when you get after him it makes things worse. Something you are doing is causing this, and you need to take a step back and analyze yourself. Again, I'm sorry for being blunt. I'm not trying to be rude, but this horse NEEDS you to get more knowledge and change the way you are doing things. He's only acting out of self preservation, and in his mind, if he doesn't try to get away, he will die. It may not seem logical to us, but that's the way a prey animal thinks.