[JamesP81]

What if the answer is: "We can't".

Then let's hope it isn't created. As a computer scientist, I concede the possibility someone might do it. OTOH, even if they did, I think we would still win the ensuing war, eventually.

There are two things in this universe I have faith in. One is God's mercy. The other is the human ability to inflict devastation. Basically, I don't think an AI would have the sheer d@mned bloodthirsty meanness necessary to kill us all before we took it down.

[Fitzcarraldo]

Basically, I don't think an AI would have the sheer d@mned bloodthirsty meanness necessary to kill us all before we took it down.

Meanness is a human trait. Most of the SI researchers espouse a humanistic/relativistic reality anyway. Will they program SI with the 10 commandments? I don't think so.

In terms of lethality, an SI analogy to a nuclear weapon is that the software is the trigger and nanotechnology is the lump of plutonium. Kept separate, we might have a chance. Together, the world could be transformed into "computronium" overnight.