Shut down the department, fire them all, ban them from any future govt job.
*************** And force the numerous scofflaws in the IRS to pay their back taxes.
A related story on IRS abuses FYI.
http://www.washingtonpost.com/news/morning-mix/wp/2014/04/23/irs-gave-bonuses-to-employees-who-owed-back-taxes-and-thats-not-all/