The IRS (with its 74,000 pages of tax regulations) provides a very nice living for a huge corps of attorneys and accountants.
That alone will make it very hard to displace or modify.
Or as my husband points out, think of the brain power wasted by the smartest people in the US, trying to figure out how to pay less taxes, which could be used for doing something more productive.