You have to face your fears. No one can get over them but you.
I had a bad accident many moons ago. I was told by the surgeon to never ride again. I didn't for a good year but started riding a naughty pony, that was playing a child I was teaching up.
I was very careful over what I did rode but then started working with a horse dealer. I took quite a bad fall on a horse we were trying. I decided there and then that if I was going to end up in a wheelchair or worse then that fall could have been it.
Threw my worries over my shoulder and never looked back.
Just rode what you are happy with and the bug will bite so you progress to roding as you were.