The tariff doesn't eliminate the cost. The tariff helps to eliminate any unfair advantage to the foreign producer due to these costs.
Again your suggesting killing the patient to cure a rash. We can eliminate all of the above costs to companies, by off-shoring all of the companies. But then we won't be able to afford to buy their products even though they are cheap.
Better to make foreign producers pay an amount equal to what domestic producers have to pay. That eliminates the unfair advantage.
Oh OK so then tariffs are to offset the cost of compliance to government regulations and taxes and thus we give Congress more money to spend. (The tariffs go to the Gub'ment. Right?) And if you get the Tariff high enough it will offset the compliance costs and companies will start building manufacturing plants in the USA.
Is this your position?