This kind of sterotypes people. But I've found that folks with the energy to get off the beaten path and enjoy Mother Nature as a whole be very enjoyable people to be around. Not the typical drug addicts trying to feed a habit. Which seems to be more on the lazy side than having the energy to hike 10 miles into the back country.
But like Darrin, I probably don't get many women excited enough to want to attack me. And most banditos realize I don't carry my wallet when I ride, So about all they can steal is my lunch if they attack me on the trail. A single young attractive female probably offers more reward and probably faces a smaller risk than attacking a large cowboy who often has a pistol on his hip.
I worry more about locking up the rig when I leave and finding it broken into when I return than about anything happening along the trail. That has never happened to me or anybody in my group, but you hear stories.
I have surprised a few couples rolling in the weeds along trails closer to home and the occasional girls trying to get a no lines tan on weekday rides when they thought trails would not be in use. But alas, the topless beauties were content to giggle and let me ride by vs attacking me.