Fine line... Agreed.
Most of the time I would ride with contact. You kind of have to read the horse you're riding and feel if that's the appropriate way to ride it.
However, if I'm on a horse that likes to throw it's head or hold it too high, I ride it on a loose rein.