[sharktrager]

There is a difference between Freedom of Association and actual association. The right is great, but their choice seems poor.

I have Freedom of Speech. It's still stupid for me to go walking through Wal Marts yelling insults at everyone I see wearing purple shirts because I don't like the color purple.

[demosthenes the elder]

Interesting analogy, but flawed.
Yelling insults is not merely free speech, it is in many jurisdictions a form of assault and illegal.

Here's a mod of your analogy: A mall in Maine banned the wearing of anti-war/anti-Bush apparel on their property. Two people deliberately defied that rule. They were told to remove the shirts or remove themselves from the property. They refused to do either. They were arrested for tresspass.
Was that wrong?