"If you remove non-income tax taxes from exports the other countries will remove their VAT taxes which will leave you with no change."
VAT countries already do that; it is one of the main principles behind VAT taxation. Therefore, there would be no change in this respect.
They have non VAT taxes as well.