That's a very good point.
On one side you have combat veterans, skilled recreational shooters, and rugged outdoorsmen. On the other side, you have a bunch of worthless lawyers, limp-wristed men who have never fired a weapon, and metrosexuals.
As for those who say 'they'll just send in the military after us', consider this:
Everyone in the military took and oath to protect and defend the Constitution. Most of them take it pretty seriously and would not engage in activity against the American people.
I believe you'll find the more "skilled" the soldier is (special forces, fighter pilot, senior tank mechanic, etc....) the more likely they are to support the Constitution.
Unfortunately, the Delta Force was used in the murder of the Davidians.