OP, your las comment gave you the opening. When he calls, just say something like "Great! We'll meet you at noon!". Then head out at 9 or 10 on your real ride and meet up with him at the discussed time. Not a big deal, really. He sounds like a good cool-down ride.