First, it's never a fault of the horse. That leaves the rider. :) Yet, it'd be wrong to shame you for it; to find a horse who's beyond your present skill level is normal, & can be a gift to you as it provides the challenge for you to improve your skills!
If this horse is unmotivated, calmly ignores you, calmly & deliberately goes against what you want (moving off the rail), you've got a Left-brain introvert. (the first thing is to see if a horse is doing what you don't want calmly or from fear/adrenaline.) To get into a fight/kick him/pull him won't work; seems that you've discovered that. So, you're left with what will MOTIVATE him, & since LBI's are food-motivated, FOOD gets this horse's interest. It's not a food reward EVERY time he complies, (that teaches him to demand a treat EVERY time) it's surprise food rewards, when he thought you'd blow your cool, & randomly spaced rewards for complying. Eventually, you'll phase out the treats, because he's gotten interested in your leadership ideas, & will even offer moves to you!
He's trying to frustrate you, because prey animals are experts at frustrating humans so that they'll give up, so if you get emotional, he chalks up one for himself. I hope that you can see that no one should deal with a LBI who has no sense of humor!
Parelli has detailed info on this & the other 3 main "horsenalities". There's clicker training, too, which is great for food-motivated horses.