This idea that any ship hit is "done for" does not withstand historical scrutiny.
The tin cans of that era are a far cry from their modern descendants. They had actual armor, where a modern DD generally doesn't.
Also, most of the weight of a shell is the shell, not the warhead/payload. The Silkworm actually carries more explosive than a 14" shell.