Barn Change and Now My Horse Is Not Himself

Exactly a month ago, my neighbors opened a new boarding facility that my trainer is managing and offered to help me out while I am at school by keeping him there to keep the first boarder horse they had in there company (she also loves my gelding and really wants to ride him while I'm away). The barn is just across the street, but my guy has not been himself since he's moved. He is stressed in the paddock especially in the afternoon and he's grumpier than normal. He also is my go everywhere do everything kind of horse and I tried to ride him this past weekend when I came home from school and we could barely even walk because he was so anxious and hot. By the time we were done riding the amount of sweat he had on him made it look like I had just worked him hard when all we did was walk. I also noticed right off that he was extremely tucked looking. He is drinking his water like usual, but I'm afraid the tucked appearance could be stress related and don't want it to lead to ulcers. What's troubling me is my trainer see's no problem with how he's looking or acting. She thinks he looks great and says he hasn't been stressed at all and has settled in well, which I disagree with. He's being fed plenty and four times a day, kept on a schedule, so I know he's being cared for, I just don't know if I should give him more time to settle in or if he's had plenty of time and should just bring him home instead. It's puzzling to me as to why he wouldn't settle because he's been hauled everywhere and just recently we went to Georgia for the NBHA Youth World Championships and he didn't have any sort of problem being away from home. I go to my trainer for everything and where she doesn't see he has any sort of problem it's hard for me to decide what to do. I want him to stay there, but I don't want his health or sanity to be put at risk. Should he have more time to settle in or is there more than likely some other underlying problem that could potentially hurt him in the long run?