Is there another horse you can ride, to get used to having spurs on, before you use them with your greenie?
If your trainer feels your leg is quiet enough, and they're used sparingly for reinforcement only, then there's nothing wrong with it. You just have to make sure, you only roll your spur on them when absolutely needed. You don't want him to become numb to the spur.
It wont fix, but it will help the problem. Your spur is just a more concentrated cue. He'll get more feel, than the widespread range of your whole leg on him.
"You're just as sane as I am."~Luna Lovegood.