It depends on what size and shape you are. I have a tiny head, and I can't go over 4 on the brim because it looks ridiculous. I have heard so/so reviews on the hh hats, some loved and others say they dont shape well, which is very important. I don't know anything about the baily. But, the 5x means quality. They can start around 4-5 and go up to 100+. Quality can also be dependent on manufacturer, etc. Once you narrow down your size, I'd recommend looking used for the best quality you can instead of buying a crappy new hat every year that won't hold it's shape after 3 months. For what you'd spend on a new 5 or 6x, you may be able to get a nice 20x used if you don't need it ASAP and have time to look. The only hats I won't spend good money on is white.