You certainly can.
But if you advertise your willingness to sell your property to the general public, the rules change.
You can't say you are willing to entertain bids from the general public and then discriminate against bids from the general public.
If tomorrow I decide that I want to sell my home, but only to a person who attends my local parish I can certainly do so.
But it has to be a one-on-one transaction.
Ok, that makes sense. I guess I'm coming from the perspective of a developer selling lots. I would imagine that a one on one transaction like that without a listing would allow the freedom to not sign into a HOA unless you're not allowed to sell your own property to someone else unless they concede to a covenant.