He stold that line from civil war General John Pope who said the same thing about the Confederacy.
Sherman had a quote along the same lines just prior to his "march to the sea", too.....