I had a goat that had a similar thing going on. I bought him and another one as young kids and they had been de-budded, but it wasn't done correctly because they both ended up growing horns. Well, one only grew one horn and the other grew both horns, but they weren't normal. One was growing in a way that if we left it go it would have grown into his skull so it had to be cut off. The other one was wobbly and would grow to a certain length and then it would break off. There weren't any nerves from being de-budded and it never bled, but it irritated him because he would always rub it against something. I don't know if that's the case with your goat, but we just left it alone and let him get rid of it himself.