Yep, sounds like my Rusty. He is disappointed when I turn him for home and always wants to keep going. Arena work is boring to him, but take him out on the trail, and he's a different horse. He can be a bit overeager and has actually taken off on me at a canter, so I like to remind him I'm there once in a while. Transitions, halts, etc. work well. I have had him stop in front of the padock gate and not want to go in. I laugh, and just nudge him in, then give him a reward once we're in (I always give something at the end of a ride). We avoid roads and traffic, but he also likes to investigate. If he sees deer, he'll want to go make friends with them. He tried to follow some turkeys into the woods. Our beekeper was visiting, wearing his beekeeper outfit, and Rusty walked right up to him to say hello (not near the beehives, luckily). I will let him look at, and sniff new things (when it's safe) and it seems to satisfy him.
So no, it's not a provlem, but you will want to remind him that you make the decisions ultimately. I would vary it with him to reinforce this. Some days you might do the loop backwards, or twice, or make the ride longer or shorter. If he resists going home, just keep the pressure on until he gives in. What you don't want is to just be a passenger while he goes out for a walk. But if he still listens to you, then you're fine.