If you are in the school of "AI is nothing but software - nothing to worry about" I suggest you read this. It will open your eyes.
It closes with warnings for the future on how to contain AI, but without concrete recommendations. The authors warn a slowdown is essential, but if the most advanced companies and countries slow down, that gives adversaries time to catch up making things less safe.
The authors point out earlier verification regimes have been built (such as the Intermediate-Range Nuclear Forces Treaty) but these took decades to build and a long time to build trust. We do not have that time luxury today.
And the verification problems persist -- just look at the difficulties in Iran and preventing it from getting fissile material for nuclear weapons.
The idea of a self-enhancing system without the prompting of humans should be a warning to everyone.
The danger is, the AI system doesn’t know what positives enhancements are versus the alternative.
It might be worth noting here that Grok writes the code for Teslas. Each update keeps getting faster, more compact and efficient code, and more bells and whistles. AI writing code for AI.
With AI “There’s no such thing as bad publicity.”
There is no plausible scenario where AI would escape human control. We are already witnessing governments escaping human control. And we have seen that throughout known history. It is happening right now.
Good Luck, Have Fun, Don't Die.
A fun movie that gets you thinking in spite of its sometimes silly nature.
Ping
In both this, and other “recent progress” I don’t see much attention to the flaws of AI.
1) Data fed AI is incomplete. Geography example: AI will show some, but not all cities, some, but not all counties, some, but not all of any topic. The result is GIGO.
2) Data fed AI is biased. Example. AI treated SPLC as a source of factual, objective data when the data from SPLC is very biased.
3) AI is designed to recognize a few figures of speech, but not many. Example. On rare occasions it recognizes sarcasm.
4) AI seems to cater its answers to flattery and ignore criticism or corrections of its errors. It will defend wrong answers... it defends SPLC as fact based.
5) There are many more. I query Google’s Gemini the most and maybe my experience is slanted. But in reading about other AI it seems that they also are not ready.
Solution #1.
AI should recognize accepted fact as distinct from speculation and guesses and as distinct from bias and opinion.
Example: Many facts about geography are accepted facts. Ft Gordon was renamed Ft Eisenhower and then renamed again back to Ft Gordon. AI is confused about this.
20 years ago the Far SW corner of GA was split off from zip code 317** and given the zip code 398**. AI does not seem to understand zip code changes, or any factual change in geography.
We do not know who had the most votes in the 2020 election. That is the fact.
AI says there was no vote fraud and it is a fact who won.
The fact is that there was proven vote fraud. The fact is that most types of vote fraud have not been investigated to know what the facts are. We don’t know how much vote fraud.
All we have are allegations by each side. AI should be factual and not present one side as factual when it is opinion.
Recursive self-improvement becomes incestuous at some point. It will just be reinforcing what it already has in its bubble.
Dude, seriously stop drinking the cool aid.
Like the global warming scam which was also enabled by academic papers instead of the real world, AI destroys the reputation of companies, products, and projects.
In the real world AI just permanently destroyed the rsync project.
” but they no longer need to supply the method”
So, given the Brachistochrone problem, Claude would independently come up with the concept of optimization by observing after much cogitation that the inflection point is the key? And also derive the auxiliary constraint equations?
Lemme know when that happens.
Thank you for posting. I just shared this with some of my colleagues.
Can AI create/build/operate a plant to manufacture transformer coils or is it just a Q&A, code generation, and design tool?