I also agree. You definitely need to use your legs with your reins. If he tends to drift to the right, you need to close your right leg and your left rein. Try jumping some crossrails too. Sometimes it helps because there is a clear distinction as to where the middle really is.