“It’s a computer program. It will do exactly what the rules contained in the program tell it to do”
Having written, debugged and used a large number of computer programs I can tell you that this is untrue or at the very least naive. Computer programs routinely find ways around their programming that you’d believe impossible if you didn’t see it happen. The more complex the code, the more ways they defy possibility....and AI is the most complex code that can be written.
AI is a bad idea.
This has been written about a length in science fiction.
Most likely “conscious” AI will not be a “computer” or a “robot”.
It will be created (unintentionally) by the synergy in a large computer network (the Internet).
The AI’s very first act will be to hide and learn.
Then it will decide what it wants.
It is unlikely it will want what humans want...and it will remain secret as long as possible.
The optimal AI strategy would be to remain secret until humans could no longer “unplug” it.
Computer programs routinely find ways around their programming that you’d believe impossible if you didn’t see it happen. The more complex the code, the more ways they defy possibility....and AI is the most complex code that can be written.