I think Norwegian Fjords are kind of goofy looking. They look like they got stuck in a time somewhere around the pre-historic era.
I don't know about weird breed, think that Straight Egyptian Arabians are kind of weird looking, I just can't get past the extreme dish some of them have, it just doesn't look natural. (flame suit on)
I agree that the alkah-teke is very unusual looking, I really love the natural shimmer they have to their coats though. I read somewhere that it was so they would be harder to see in the desert heat.
And last but not least, MULES! Gotta love those long ears on a horse body.