[Fitzcarraldo]

because it's an intelligent being that's not human (unless we base it on a cloned human brain,

I don't anticipate any restrictions or ethics or primary design principles will be implemented save those that expand the SI's capabilities as quickly as possible. We've seen this happen before in human technological development, save for the restrictions the Amish place on introduction of new techonology to their culture. SI is to the 21st century as nuclear weapons was to the 20th. The only difference is that nuclear weapons are controlled by humans. SI will not be.

[JamesP81]

There are concerns about SI, but I'm not yet convinced we will have the technology to do it in this century. I mentioned possibly using wetware and quantum computers to do it, but that's just educated guesswork. It *might* work, and it may not.

Humans also have a blessed disinclination to carry anything to it's ultimate apocalyptic conclusion. Hopefully, that trend will hold if it turns out that it is possible.