It wasn’t “confederate soil”.
Yes, it was confederate soil. They owned it and the feds should have moved out. They didn’t thereby precipitating a war. Any fed property on the soil of a state that secedes is no longer federal property.
I am sure King Geo. III had the those same heart felt sentiments about the colonies.