I guess you forgot about the tens of thousands of (some several generations American) Japanese-Americans that were tossed in internment camps during World War 2.
Didn't forget. They all looked just like the ones who attacked at Pearle Harbor. The error then was extending the "containment" to US citizens. The sins of the past should serve as a guide for what shouldn't be done in the future. Even still, American citizens at large were not restricted.
Always remember that "rights" are not granted by government. The government is restricted from interfering with "rights" by the Constitution. The Constitution does not grant rights to the citizen. It is a big mistake to allow the government to reduce rights: these are not the government's to either give or retract. This is an extremely important facit of Constitutional Principles.
Problems related to security can be handled without restricting the rights of citizens in general. To think otherwise is a mark of the incompetent.