Another rider here who has had to re-build confidence after an accident sharing her thoughts...
Your riding is about YOUR enjoyment. It has nothing to do with what other's want to see you accomplish. You get to decide what level of training and riding you are going to do. You know that you should not have attempted a jump just because people were pressuring you in to it. So why did you? I think that is something for you to figure out. Because I know if every time I stepped in to an arena and felt like I had zero ability to make my own decisions about what I was comfortable doing then I'd be nervous as heck too!
After I broke my wrist my coach helped me slowly build my confidence. I was scared but I wanted desperately to return to jumping. We took it slow starting way back to the basics. During one lesson there was a jump that I just knew had too much potential to end in disaster. So I flat out told my coach I was not comfortable doing it. He encouraged me but I held my ground and lived to ride another day. And in the long run my riding ability didn't suffer one bit.
If you love this horse and want to walk him in circles around the arena for the next 6 months and that makes you happy then do it. Eventually your desire to move up to the next stage will be greater than your fear in doing so. And with the right trainer you'll be able to improve at the pace with which you are comfortable.