We don't keep halters on our horses when they're turned out either. If I did I would only use leather or some type of breakaway so in case they do get hung up there's less risk of injury.
What they're made of is up to you. For most purposes I don't mind a nylon halter. For a horse that has an attitude I use a thinner rope halter. For shipping and shows I use leather.