Spending billions of dollars to set up other locations and to move the bureaucrats out there will accomplish what exactly? Same functions. Same procedures. Same bureaucracies. Same results. Just money down a rat hole.
Punishment.
It would not require “Spending billions of dollars”. There is plenty of empty downtowns full of empty retail space as well as empty high schools. Just rent them out, set up the LAN and they would be are good to go. Give them a small pot of money to buy used and furniture from all of the closed schools.
Also, when a federal department is scattered to at least 4 to 5 small towns they should have to fire of 75% of their workforce and be forced to hire locals to replace only 25% of the original workforce.
You do not get it. But you never do.