We need something along the lines of the German raiders of WW2 fame. Only this time to kill the pirates.
http://en.wikipedia.org/wiki/Q-ship Q-ship
Modern day Q-ships.
Q-ships