No, I think it will be lovely.
Our place is no where near as nice or as grand, but we've matched the colors of the house in the barn and outbuildings- white with black trim, grey roof and it makes a big difference in the way the place looks.
I suppose you could say we matched the architecture, but is faux Colonial with vinyl siding really an architectural style?
A lot of places look like they grew like Topsy - just expanded with no thought to overall design. Your place will look like it grew according to a preconceived design. Much better, IMO. I also like that the house and barn *look* like they belong in central PA, and that you've respected the conventions or tradtions of the region.