Try 90%. Possibly more...
For an extra $25k/annual, I'll even provide free market based solutions for any services that may have a "perceived" need. Like how to re-integrate the Air Force back into the Army/Navy/Marines. How to privatize NASA. How a model like the IEEE could be used to set up various free market consortium to take over for agencies like the FAA/FCC/FDA.
It's still a heck of a deal.
I agree with your list of agencies to eliminate completely. Add to it Department of Energy.
If we handed BLM land off to the states, we could shrink Interior down to nothing. Hand the parks over to the states, you could eliminate it.
Beyond State, Defense, and Justice, the rest are either optional or quite expendable.