Give the bit less ago I found no difference between bit or bitless with my horse. I went on a course and then after all the ground work had to go on a three hour trek in a halter. I tried to sneak the bridle and bit on my horse but the lady who ran the course spotted it. So she persuaded me to go natural. I was nervous a new horse who I had own 3 weeks. But to be honest I forgot after a while that I had no bit, he was fantastic really responsive and the brakes worked even after the gallop down the beach.
My friend has been riding for 30 years with a bit and has just had her new QH broken and she has had no problems without a bit. There is even a lady competing at three day eventing in a head collar over here.
Be brave . You could try riding in a halter with your bit and bridle at stand by (with no contact) for a while to make a change more easy.