In my opinion, the act of making other citizens liable for my individual (or our collective) mistakes is not just to infringe upon their liberties, but also their rights.
You're right.
Income and payroll taxes infringe upon the individual rights to life and liberty.
Income and payroll taxes, as forms of "involuntary servitude" imposed upon the individual, constitute a direct violation of the Thirteenth Amendment to the Constitution.
And let's not even get into property taxes.