Most ex-slaves remained loyal to their former owners and shared cropped to help pay the carpet bagger taxes.
Even Abigail Adams observed when the landscaping was being finished on the first white house that a couple of sturdy New England farmhands could have accomplished in a day what it took a crew of a dozen Negro slaves to do. Abigail was no racist. She was an ardent abolitionist even in those days and correctly observed the stupefying nature of the institution of slavery . . . most would work only the minimum necessary to avoid the lash.
Not so different than what happened in Soviet and Red Chinese agriculture when farming was collectivized. Once even partial private ownership of small plots of land was introduced in the post-Stalin and post-Mao eras, food production soared.