It is SO nice to have so many people write words of encouragement. I, myself, am rebuilding confidence. In 2004 my inexperienced horse bucked my off and I broke my humerous. Several horses after that that I looked at weren't finished and tried to buck me off. One did buck me off, and I am exceedingly happy that I tried him sans stirrups, else I would have been dragged. Although your fears are substantiated, I APPLAUD you for working on your confidence. I can assure you that there ARE horses out there who are not frightened by skittish riders.
My lesson horse, "Ro Go Bar" (QH) was one of them. I once gave a private lesson to a nervous rider with him and she just sat on him for an hour while we chatted, his back leg cocked, him trying not to doze off. It really helped her a lot. She wanted to ride him exclusively in her group lessons after that, and I agreed with her.
Right now I have great confidence in my 13 yo mare, but I am careful to ride my two 5 yo geldings in safe places, and I do ride them with my helmet on, even though they really haven't been spooky.