At that point - 1864 - most of Louisiana had been freed from the Southern rebellion and had established a loyal U.S. administration in Baton Rouge. These were the people Lincoln was trying to influence, to no avail as it turns out.
That is kind of like Obamao telling Israel who can live in Jerusalem neighborhoods. You probably think that is ok though.
Israel is not part of the U.S. Louisiana is.
“Israel is not part of the U.S. Louisiana is.”
But they were not in 1864.