I don't see anything wrong with anything that was just described. I think the people who are giving you grief just don't understand the discipline and see the unfamiliar as scary and dangerous. It happens. You may try to ask any of them if they have any questions.
I know with my guy, I'll get odd questions or I make jokes about his breed. I call him "Crazy Pony" and make jokes about him being weird and having quirks. It seems to make people feel more comfortable and then they'll ask me questions. Most commonly, I am asked what I do with his tail (I braid it and vet wrap it), why he's small/if he'll get bigger, what I'm going to do with him/am I going to jump him, etc, etc.
I would just take other people's comments with a grain of salt, answer any questions they have, and try not to take anything personally.
The wind of heaven is that which blows between a horse's ears. ~Arabian Proverb