I would just replace the entire federal government, top to bottom.
I would get rid of a third without replacing them. That includes EPA, BATFE, Department of Education, Department of Energy, Bureau of Land Management, and many others. I'd prosecute anyone at IRS, BLM, or elsewhere who abused government power to persecute conservatives or any other innocent, law-abiding citizens.