in January 1865
from Wikipedia:
“Although Butler’s governance of New Orleans was popular in the North (where it was seen as a successful stand against recalcitrant secessionists), some of his actions, notably those against the foreign consuls, concerned President Lincoln, who authorized his recall in December 1862.”