If a U.S. court interprets that to mean that the President can unilaterally impose tariffs on his own, then your constitution isn’t worth the paper it’s printed on.
Its not always practical to have 535 people trying to manage something. And so some things do get deferred. Expecting absolute Constitutional conformance is simply not how things really work.