In article one of the U.S. constitution, congress has the right to grant marques of reprisal. This could allow them to authorize a private ship to bear arms and ‘deal’ with pirates.
I probably am remembering this wrong, but I thought treaties were the one thing that could override constitutional provisions.