I'm the same, if I didn't have an indoor the chances of me riding in winter would be slim to none
If we get nice, clear, not windy days I will ride in the woods behind our pastures. Yesterday was the first truly cold enough day to keep me inside so far this year (it was 25 F) Been lucky to have decent weather so late.
Mine that are already finished only get used for lessons and my daughter to ride through winter, so easy rides a few times a week. I condition them again in the spring. My own youngsters & client horses, don't have much choice there, I work them 6 days a week. If your horse is one that is the same if rode daily or once in a blue moon, don't beat yourself up about not riding as much.