I disagree, the right to privacy is clear in the enumerated rights. As just a few examples, the rights to freedom of religion, freedom of assembly, protection from unreasonable search and seizure, and protection from being forced to board miliary in one's house all depend on the assumption that a person has the right to run one's life as he or she wishes without undue interference or supervision by the government.
It means the government can't arrest you for holding meetings -- meaning you don't have to meet in seclusion (privately) -- nor can it persecute for going public with what you believe.
The 3rd & 4th amendements protect property rights and freedom of movement i.e. police cannot search your person at will although that's another thing that has been twisted all the while legal pundits scream privacy is a right enshrined in our Constitution (and I don't mean you).