The IRS cannot be abolished, someone has to collect the taxes.
It can be significantly downsized though and its intrusive enforcement unit abolished or converted to immigration enforcement.
It sure as hell can be abolished. If someone has the will.