Before just assuming the he doesn't like the bit- have you had his teeth floated? Does his saddle fit? Did the bit fit? Is the a chiropractic issue?
If you've ruled that all out, and choose to ride bitless regardless, read on.
If he goes well in a halter, why not try a jumping hackamore ( Google Image Result for http://www.galadriel.shaftnet.org/horses/duchess/jumping-hackamore.jpeg
)? It's the same idea as a halter, but more stable on the face and more attractive.
If you're looking for a little more control, I would suggest a zaum bridle ( Google Image Result for http://equineink.files.wordpress.com/2008/04/lg-bridle.jpg
), which puts pressure on the bridge of nose, jaw and poll, but is still mild and allows you to direct rein.
There are tons of other bitless options out there to try. Another option you might look in to is an indian bosal, a crossunder bitless, or a lightrider bridle.
Find what works best for your horse, and for you. Good luck!