But it belonged to the United States. Why allow the rebels to steal that property, too?
I disagree. As of Secession, all former Federal Property became the property of the C.S.A.