I don't think he was talking about a "camp" with guard towers and such, unless they were facing out for protection rather than in. The refugee camp is for your family. They'll need somewhere to live while you're off doing your "patriotic chore". At least until better digs can be found or built.
Don't confuse a refugee camp with a reeducation or work camp.
I took it in the context of a friendly area.