Keep in mind there is considerable (justified) paranoia out there. The aware American KNOWS that BOs minions are watching anyone joining such groups.
You are correct, but there is safety in numbers, that's why I say join the growing crowd...
National Rifle Association (NRA)
Second Amendment Foundation (SAF)
Jews for the Preservation of Firearms Ownership (JPFO)
Alarm and Muster The document that started a movement.
Alarm and Muster The Modern Day Call Tree for Emergency Preparation.
And be sure to join your State/Local Gun Rights group.