Those other agencies can actually be abolished. Since we need to fund the federal government, we need an IRS. (Though sure, taxes should be cut and simplified.)
If we institute a flat tax or preferably a version of the FairTax, IRS at about 5% of its current employment would be appropriate.