How to tell a friend I don't enjoy riding with them?

Oh I am so with you livestoride, I have the same problem with 2 sets of friends, one or the other of which is always after me to ride with them. And they walk, and they dawdle, and they stop, etc. etc. Plus they are all fairly new riders and if I pick it up even to a trot or any faster gait, someone gets upset. Maybe this thread will do me some good too, I've been trying to get out of riding with them even though I love them dearly.

He has made his problems your problems. Stop being such a push over. He going to show up without a saddle ? Well sucks for him. Seriously , if he calls and you are riding that weekend, tell him your going but will be moving along, see you on the trail. Last year I learned one little sentence that made my riding so much more enjoyable and stress free,
Don't wait on me and I'm not waiting on you, see you back at the trailer.

I had a similar dilemma last year. One woman I ride with like to haul butt and the other mostly walks. I decided to just put it out there and tell both of them that I will go out sometimes with one and sometimes the other, so we don't frustrate the horses. It's funny, but putting the excuse on the horses made it okay for all involved. Similarly my horse always seems to know, when we're out with horse A we'll be moving, and with horse B we'll be walking. He doesn't seem to care either way.

I have ridden with both extremes and it is annoying. Open communication is really the only thing that will work. Like Joe mentioned, the guy isn't even using a saddle, so he can't be in for a serious ride. Maybe he would be happy if you went for him on a 30 minute ride after your main ride.

OP, your las comment gave you the opening. When he calls, just say something like "Great! We'll meet you at noon!". Then head out at 9 or 10 on your real ride and meet up with him at the discussed time. Not a big deal, really. He sounds like a good cool-down ride.

Thanks for all the responses. He called us this morning as we were in the truck heading to the trail head. Per advice I got on here we just told him we were wanting to put some conditioning miles on the horse and would be moving along. At first he said he didn't mind some trotting, but we just cut him off a bit and said that we would be glad to give him a call when we were done and catch up with him for the end. Thanks everyone!!!