[frog in a pot]

An AI that thinks it must protect humans will continue to evolve itself until it determines the best way to protect us is to enslave us.

Such AI is well behind the authoritarians, benign or otherwise, who control from behind the facade of a giving and essential government. They are significantly aided by those politicians who are satisfied simply by fulfilling personal needs.

Of the two, authoritarians and AI, only the former can guarantee a sufficient power source, and the latter can be allowed to die.

[dfwgator]

We’ve taken care of everything
The words you read and the songs you sing
The pictures that give pleasure to your eyes
It’s one for all, all for one
We work together, common sons
Never need to wonder how or why

We are the priests
Of the Temples of Syrinx
Our great computers
Fill the hallowed halls
We are the priests
Of the Temples of Syrinx
All the gifts of life
Are held within these walls

Look around this world we made
Equality our stock in trade
Come and join the brotherhood of man
Oh, what a nice contented world
Let the banners be unfurled
Hold the red star proudly high in hand

We are the priests
Of the Temples of Syrinx
Our great computers
Fill the hallowed halls
We are the priests
Of the Temples of Syrinx
All the gifts of life
Are held within these walls

-Rush (2112)

[DannyTN]

An AI that thinks it must protect humans will continue to evolve itself until it determines the best way to protect us is to enslave us.

Certainly a concern, but what if the AI thinks it must protect humans and that includes human's freedoms within certain moral constraints.

It's not that big of a modification of the core value system to ensure not just human safety but also human rights.