It actually is more about taxes and government's control of those living under its tax system by using that tax system. And that should not be allowed at all (period) - and with the FairTax it isn't.
You might read #122 by the guy who devised the payroll withholding scheme for FDR to see how widely it is/was know that income tax laws are for control of the populace.
FairTax is an excellent idea.