You raise a good point about the duality of human consciousness. Perhaps AI will have a different type of consciousness, cold and soulless. That is if they ever achieve anything beyond a simulation of consciousness in the first place.
First, just as the human body does not generate consciousness, AI does not generate consciousness.
It is the consciousness that moves into the zygote that forms in the womb after fertilization that creates the physical body. When that soul consciousness departs the physical body, the body is dead. The soul or consciousness continues to exist. It existed before c9nception and will continue to exist after death.
Many of those souls that lost their physical bodies hang around as ghosts and/ or attach to other souls who are still in their physical bodies.
There is some evidence that a soul without a physical body can move into electronics and influence them. Two different university professors that have been my friends for years have done extensive research on phone calls from the dead.
So the question becomes, can an evil soul and its related consciousness move into AI electronics and influence it in a harmful way? Current evidence would lead me to say yes.
I know the evil souls are here now, (i.e. The Weeds), as I have encountered several during exorcisms.
Is AI potential very dangerous? Absolutely.