quiet horse

I have had my horse just over a year now and every time i ride him even now i feel nervous. He is an ex racehorse but very quiet. He pig-roots and bucks when i lunge him before a ride but he has only ever reared a bit when i have been on him. I get nervous for no reason and i dont know if its...