Let me answer your question with a question. Do you trust the Federal government to determine how diverse the economy should be?
Aren't they doing that now? Don't all of the taxes and regulations help put American workers at an expensive disadvantage against foreign workers? Aren't these, in effect, restrictions of trade?
Scrap the income tax, and fund the legitimate functions of government with tariffs on foreign goods. Let that be the boulder around which trade otherwise flows freely.