Just a couple quick comments...
When I do feel the start of an urge to ride, my kids always want to, and so instead of getting in the saddle myself, I let them, and play babysitter.
We all need some 'our time' to relax, do what we enjoy, and put ourselves 'first'. Don't feel guilty as there is nothing wrong with sometimes telling your children that today you're going to ride by yourself.
And to make things worse, now I feel guilty every time I think about riding or playing with them, because there is always so much other stuff that needs doing. Mowing, trimming, fixing fence, cleaning tack, repairing things, the house, dinner, the list goes on for miles. I don't have enough hours in a day to get my work done, much less play.
There will always be more to do than there are hours in the day and it's a constant prioritization of what gets done. Again, don't feel guilty to sometimes put yourself at the top of the list! Although our child is grown and on his own, still working full time (luckily, from home) and having our three mares here at home with us takes up a lot
of time. Sometimes the grass gets a little long, or a fence that needs repair gets a 15 minute patch up job that will be 'good enough' (i.e. Safe) until I have time to fix it right, but I still put aside some time to ride and enjoy myself even if it is many times only once a week.
By the way, my wife was a 'stay at home' mom and I fully appreciated that her day was full
of work even if she said that she (seemingly) didn't do anything.