I have seen dozens of goats, sheep and cattle with loose horns and I have never seen one that became firmly attached again. They are animals and they bump into things and keep it loosened up. I'm not trying to offend you but that is my experience. I hope you have better luck.
Yep, Kevin's right. It will grow back, though. And it will be deformed.
As far as flicking off the goat, meh. The goat obviously doesn't care, so why should you?