FAIR OR not, You are not as involved as someone who does most of the care on their own horse. The person whom cleans their own pens, holds their own horse for the farrier and Vet , knows the horses habits better . If I only went out and brushed and rode my horses , EVEN when I did board, I would not know if my horse was having issues. I could tell by my horses if there was to little poo per day , then to get him oiled or start a round of psyllium . I could also tell by the poo, if a teeth floating was needed.
It does not mean you don't have concerns or care emotionally less than anyone else. It means you don't have the time . You should not complain to have to go hold your horse for your farrier. Thats sound spoiled bratish.