Uhmmm. . . . Don't fall off?
Other than that, put it in a carry case, in an inner pocket. You don't really need to get to it during a ride so it doesn't have to be easily accessable. Heck, probably wouldn't hurt to turn the fool thing off! You just want it for emergencies.
Anyone who just HAS to answer the phone when out riding probably needs a different hobby!!