Yes you can. HTML Tutorial
This website explains all the basics of html.
To get to your html you will have to go to your cpanel and find the files for each page. You can google pretty much everything to show you how to do that.
I'd start with reading up on the site I linked to, then google cpanel, and have at it.
Google, google, google! Good luck!