I would have given him a verbal scolding but not have gotten all over him about it. He should have been paying attention to where you were and he wasn't, which is why the verbal correction. He didn't mean to hurt you, and his startling shows it.
Moving forward, I would brush his sides really well so when you get to his belly, he knows it's you. At least until you get to know him.