I know how you feel. I fractured my heel over the summer, and it really sucked. For the first week or two I held off riding...but after that I just made sure I wore a few extra pairs of socks on my right foot to give it some cushion and I rode anyway. Probably not the best idea, but oh well.
Most of my breaks were caused by the little buggers on the ground, not while riding. My foot twice, my hand once, and a cracked rib from a body slam against a concrete wall. I'll take my chances in the saddle, lol. Hope you heal quickly!