It only 'costs' the government money if you believe in static models and assume that all money is the government's, and we are lucky to keep some of it.
It is the government that is a "cost" to us, not the other way around. And the way "we" reduce costs is by eliminating spending. So let's get on with it.
It is the government spending that is choking our economy with huge bureaucracies churning out endless regulations and harebrained "investments".