I believe no one raised hell because the ones in SE US were camps for German WWII soldiers, actual POWs from Europe, noty US citizens of German ancestry. Some other German-Americans were rounded up and held because the FBI or other law-enforcement authorities deemed them a threat because of suspected involvement in Nazi party activities in the US.
Some were American citizens. Just like the Italians held on Ellis Island were American citizens.
Note: Not all Japanese Americans were rounded up and put in camps. I know of one family in which the grandparents still hold bitter feelings toward each other because one set took off from SF and didn't go to the camp and the other set stayed and was sent to the camp.