This is just not true. If you and I are neighbors and we sign contracts that say we will not paint our houses in primary colors, and then you do, you have violated the contract. That is what a Homeowner's Association is. If you don't want to abide by the rules of one, don't buy a property that is subject to one.
But you cannot say, "I love this house, how all the neighborhood houses are alike, how none have ugly trim, and all the mailboxes match and there are no cars parked on the street, etc, etc, etc. I want to buy a house here and violate all the rules that made this place attractive to me."
I would never have anything to do with any such contract. Voluntarily giving up your rights to a governing authority is not liberty.People who do that would not be uncomfortable in giving up their rights to the national or state government in return for some material benefit. The mindset is there.It doesn’t take much to go the next step and the next. Socialism is so nice and secure.