The real possibility of stiff reprisal may make them blink, offering token apology and declaring it as their victory. That has happened before.
Otherwise, this cycle of provocation would continue. NK would see no risk in another provocation. Moral hazards in military terms.
Why not take out some Nork subs? http://en.wikipedia.org/wiki/List_of_active_North_Korean_ships