Acutally it mentions freedom of assembly, not association. And it's a bit of a stretch to say that "assembly" means living together.
A government cannot legally tell you whom you can and cannot cohabitate. This is a slamdunk.