My guess is that it began as an urban legend, since western North Carolina in general and Rutherford County in particular were strongly Unionist during the Civil War.
Few areas of the Confederacy were more reluctant to secede than this almost slaveless region.