I went through a period of being very scared of riding, and ESPECIALLY jumping. All in two weeks, I had my first fall ever off of my trainer's new supposedly broke horse (he bolted, bucked four times HUGE and I just went flying, landed on my front, was covered from head to toe in bruises and scratches, dislocated my knee, and completely broke my helmet in half, thank god I was wearing one!), then when I got back on after my knee felt stronger, my favourite, super well broke lesson horse took off bucking, with his hind legs coming far above his head every time. Although I didn't fall off, my confidence was totally shaken. Right after that, I rode another horse, and somehow his bit was on backwards (none of us can figure out how it happened, or how no one noticed), and he, too, ran straight through the bit, and throughout the hour-long lesson, he bucked 17 times. At this point, I really didn't want to be in the saddle anymore.
What really helped me was taking my favourite horse for walks (on foot) every day for about a week. I brought a body brush with me, and we would walk down this nice grassy lane, then stop every now and then, and he would graze while I gently brushed him. We just enjoyed each other's company with no pressure that comes from riding.
After that, I went for lots of trail rides at the walk on completely bomb-proof horses with a few older ladies who didn't want to do anything more than meander along the trails. When I was sitting on a horse comfortably and confidently, I started riding with a trainer who just stood in the middle of the arena and told me what to do, but without the pressure of her perfecting my riding. For a couple weeks, I was just re-learning how to enjoy riding. Pretty soon, I was very eager to spend a lot of time in the saddle, working on my horsemanship. It just helped to take a break from serious riding, but not take myself out of the horse world completely. Within a month and a half, I was jumping again.
Do what feels right for you, but you obviously love horses, and used to enjoy riding, so I think you should stick with it. It's a lot of work, and there are always times when you don't want to do something (riding, jumping, mucking out a stall, etc.) but it's just a part of what you love, and you just need support and a little push. Good luck, I hope you choose to continue working with horses.
Where there's a bay, there's a way!