If I am interested in controlling what happens to the house next door, I should purchase it. Otherwise, I should shut up and mind my own business.
In an HOA neighborhood you agree to maintain to a community standard. In a non-HOA area then anything goes.