I am old school and was raised where trail riding was just that, riding on a trail in the Sierra Nevada Mountain's growing up and when my dad and I were together or took others out, we were courteous of others and those who's skill was not as good as ours. A trail ride is suppose to be enjoyable, if one person in a group wanted to lope or move out, then we would ask EVERYONE if that was okay or to alert them to check up their horse, they would walk by then at the head of the trail let their horse go.
If we had an older horse or a green rider or green horse with us, again, we keep the pace at a walk or what they were comfortable with. We at that time, had no cell phone to take with us if things should go wrong or we had a hurt horse to call for help, we relied on each other and the knowledge that was in our collective group. We also stayed at the pace of the slowest horse and I NEVER leave anyone behind.
Someone ever jerked my bridle off or tried to, I have long reins for a reason, your going to get them laid over whatever body part happens to come into striking distance. If I can't get you when you haul freight by me and think it is funny, you won't be laughing when I get back to camp. Horses are powerful animals and even the most well trained one may have an off day or spook or bolt and people get hurt or have a bad day too. I have gone out on my own when in a group of riders when I felt what they were doing or where they were going may be dangerous and won't take risks with my horse. I was on one trail ride where one guy, on a mule, thought it was funny to get ahead of the group them "jump out" at us screaming! My poor mare was on edge for a lot of the ride and we finally said enough and turned back around. Took me longer to find my way back to camp, as I had never been on that trail before, but we did it. I don't suffer fools well.
If it isn't fun, then don't do it. Can you get those riders who are looking for a more relaxing, safe ride together and you all go out on your own? Is that a possibility?