Funny, I had this conversation with my farrier this morning. My horses are very good with the farrier and he always comments on how exceptional they are and what a pleasure they are to work with. So I told him they'd probably be better but I only ride on the weekends. That said, we ride all day, or rather, spend the whole day with the horses under saddle. We stop for lunch and take a break for a hour or so every once in a while.
He tells me most horse owners don't ride more than a few times a year, that my wife and I (who ride pretty much every weekend) ride as much as anyone other than the full time trainers he services ride. He then tells me about all the horses he shoes where the horse is somewhat difficult.
I do feed and groom twice a day and clean stalls every day. I spend two to three hours a day at the barn, with and/or around my horses. I clean feet every day. I'm lucky to have my horses here and don't have to board so I can spend the time many spend driving doing the things necessary to care for my horses but I seldom saddle and ride here.
So, I guess, the truth be told, according to him most horse owners don't ride everyday. The dozen or so who responded being the exception, as clearly there are some people who do ride everyday.
No need to feel guilty, just do the best you can and enjoy the time you have with your horses as best you can.
For we wrestle not against flesh and blood, but against principalities, against powers, against the rulers of the darkness of this world, against spiritual wickedness in high places.