Tie it with a string. Loop the string around the button, go around your back and through the number, then come back to the front and put it through the button hold. Button your coat. Make sure no loose ends are hanging out.
Here's a pic of front and back.
I've also seen some really pretty magnets on e-bay, which looked like a great idea and I'm sure would be seriously frowned upon in the hunter world.