I have to go with sdellin. RELAX! If you are tense, then the horse will be tense but if you relax, they will feel it an relax too.
Feel the reins with your fingertips, never hold them in your fist.
Keep your weight off your feet and on your butt. You will be more comfortable and have a steadier, deeper seat too.