Moving is fine.
You think Blackburn will support eliminating or even seriously cutting Education when it costs jobs in her state?
The unintended consequence of this could be that Senators and Representatives of states that get headquarters will be much more inclined to fund these agencies.
It's the same as defense contractors spreading work all across the country so their programs never get cut.