I'm about as libertarian and pro-property rights as they come, however I do concede that I see some wisdom in zoning laws when it comes to historical neighborhoods.
There is a lot of character and neighborhood cohesiveness that can be completely undermined by one ugly, out of place home built in a historical neighborhood.
Amendment V
"nor shall private property be taken for public use without compensation."
If a community wants to "preserve" a historical district, then the community must compensate the private property owners for the cost to preserve the property in the manner in which the community wishes for it to preserved.
Remember the "preservation" is for "public use."
Historical neighborhood? Be careful what you wish for.
But where does it end? Once a government agency or body starts deciding what is historical, they'll move into what's tasteful as well. If McMansions start going up, that means property values are high. Those who object to the aesthetics can sell and live someplace else.
One of the most charming of American towns is Eureka Springs, Arkansas. I have spent a lot of time there and never tire of it. It is set in the Ozark hills and has a Victorian flavor. Even the McDonald's is done in Victorian style. There are no stop lights anywhere in town, but the traffic still flows pretty well, even when there is a lot of it. About a year ago, they allowed a Dollar General within city limits. I'm not sure how that happened, but it is a terrible eyesore. Fortunately, it's kind of on the outskirts of town, but still. They should have put it over in Berryville near the Walmart or something.
I agree with you about the building codes. Generally I think people should have the right to do what they want to with their own property, but sometimes, especially when the attraction to a community is a certain historical or architectural flavor, that flavor should be preserved. Of course, anyone wishing to live in that community should know and agree, up front, to maintain the historical/architectural integrity of that community. The rules shouldn't always be changing and there should be some common sense room for flexibility within those guidelines.