Calling for an end to the IRS is foolish. There will always be taxes. There will always be tax collectors.
There will indeed always be taxes and tax collectors. But to conclude then that there must be an IRS is bogus man.
The obvious contradiction is state sales taxes. There a tax and there are tax collectors - but no IRS.
The method of tax collection matters greatly wrt freedom.