You are right. What about the term evacuees?
"...What about the term evacuees?..." An evacuee is someone who is removed from a threatening situation which seems more appropriate to what is taking place.