I think that’s how it was originally in the US until they added the first excise tax on alcohol, which kicked off the Whiskey Rebellion.
So the tariff-only approach lasted one presidential term I think.
I actually have this quaint theory that an income tax is slavery by other means. If a 100% tax rate is pure slavery (you don’t own the fruit of your labor), then a lesser percentage is but a matter of degree.