Yeh, because he has no authority to tell them to leave. 😀
Right now they are there as ordered by the State Governors with the permission of the President. But he could in fact order them gone at any time.