You def need to reestablish that you are ALLOWING him to come inside for dinner. I wouldn't let him come in off the lead any longer. When he's coming in don't allow him to be pushy.
Rope halters work well for most exercises, though if he is really getting into your space or being dangerous, you may have to switch over to a normal halter and a stud chain.
It's very important that horses understand that they must respect you... they're way to big to be acting dangerously.