Finding good riding gloves is a challenge, especially if you need some for colder weather. I searched high and low and bought several pairs before I found one that I really liked. And guess what, they weren't actually labelled as riding gloves - I found them in a store for work clothes, but they are Thinsulate brand and are wonderful. You need the right materials for a good grip, but without freezing your hands. My extremities tend to get very, very cold so good gloves were a must. Oh, and layering is ok if you have to, but those chemical packs are useless in my opinion.
Also, good socks! And a good coat, which again, is a bit of trial and error. I've also found that in shedding season, I NEVER go to the barn without wearing splash pants over my breeches - you know, those nylon pants you wear over your clothes. That way when I'm brushing my horse, hair doesn't get all over my breeches. I take them off to ride, but always have them on for everything else.
And I agree with everyone else on the fleece. You'll appreciate slick surfaces that hair, hay and dust don't adhere to.