Ignore the ladies in this thread, they just love to see a guy in tight pants! :)
I think you should go up a size or two. Loose fitting breeches are not only much more comfortable to ride in, but also more "forgiving" in regards to the male anatomy becoming visible - think how the ladies do not like visible panty lines... the same rule applies (or should apply!) to us.
TuffRider makes decent breeches, btw. I use their TuffRider Coolmax Pro's and they look almost identical to Tailored Sportsman but hold up better and are a bit cheaper too.
The hardest part isn't finding what we need to be, it's being content with who we are.