I don't know if the astronauts would consider it safer! 10 milligrams is equivalent to 500 tons of TNT. And if that's not bad enough, the exposure from the gammas would unquestionably be fatal. At least with a chemical rocket you theoretically have a chance to get away from a dangerous rocket with an escape mechanism (like on the Apollo program).
I think you overestimate the danger with a nuclear reactor. Nuclear reactors don't suddenly explode and vaporize everything (especially their fuel). And even if they did, you could apply your caveat of being in the middle of the ocean. Any way you look at it (unless you have accumulated significant radioactive material in the reactor core), the nuclear option is safer. The nuclear option will only be dangerous if you take active measures to make it that way (violate safeguards, etc). The antimatter option is only *safe* if you take active measures to make it that way (ensure confinement).
Captain, we have a warp core breech - ejecting the core now!