I get very frustrated too.
My horse is a TB off the track and he constantly sweats causing heaps of dust, plus he is large and loves to roll.
I spend a long time grooming him before a ride just to ensure he is looking and feeling clean..
But all I can do to make it any easier is chuck a summer cotton on him and it does make a huge difference.
So I'd chuck a light weight rug on to reduce dust...