If you have the $$ to buy a saddle for every horse you have - go for it. Otherwise, buy a saddle that is comforatble for both you and your horse and don't worry about it. Of course, if your backside is as big as mine, the saddle color won't matter - 'cause no one will be able to see it!!! ;)
That is my though exactly. Brown goes with anything, doesn't it?