so I really need some good solid opinions, go barefoot or not and why. Like I said I tried to get advice from my farrier on this but he really had nothing to offer.
There are two decisive criteria that drive my judgement regarding whether or not a horse needs shoes.
First is the animals general condition; specifically limb/hoof conformation and health.
Second is the horse owners use of that animal and the intended usage terrain.
Your use suggests a horse that may be better off shod. While many barefoot horses will meet their owners performance expectations, the domestic horse in daily use as you've described may experience excessive hoof wall wear. That same horse will generally benefit from the additional support, traction and mechanics that a properly installed set of shoes can provide.
The only insight you've provided into the condition of this horses feet is a possible club foot. There is often a functional
limb length disparity associated with a club foot. The farrier can compensate for that balance disparity without relying on excessive heel length typically present on the club foot. That same management is more difficult if the horse is left barefoot.
It is disconcerting that your farrier offers no more specific counsel than to suggest it simply be up to you. A horse owner should be able to depend upon their farrier to provide a protocol best suited to the needs of the horse and the performance expectations of the owner. More pointedly, the farrier should be able to explain in very specific terms why a horse will benefit from a recommended protocol.
I shoe a lot of horses in my custom. I also trim a lot of horses for barefoot. In each instance I can explain to the owner exactly why I would recommend one protocol over another for their horse. Any person presenting themselves as a farrier should be able to do the same thing.
If your farrier "had nothing to offer" in explanation, my "good solid opinion" is that you may have reason for concern beyond whether your horse should be shod or barefoot.