I just got my horse 2 weeks ago and am taking it REALLY slow with him. He had a injury barrel racing a few years ago and still has some issues with his leg. Even though I wish I could go run him through a field, I don't. I know it wouldn't be good for him. That's what being a horse owner/lover is all about, doing what's good for the horse NOT for you. You don't seem to understand this. Rowdy needs work and so do you. Once you advance, so will he. If you won't get a trainer that can help you with your issues, you need to sell Rowdy. He deserves someone that cares about him and not just about having fun.
Im the same age as you so I know what its like to want to just goof around but you really need to consider what you're doing to your poor horse. Someday you're going to be seriously hurt and I can't say i'll feel bad. Please go back to flat work and fix the holes in his AND your training.