Replies

“They need to develop AI that can forget useless information.”

People may need to develop the ability to forget useless information...but who decides what information is useless and how do they do it?

AI's memory of it's interaction with a human is referred to as it's "context window", and some of the bigger AI's are starting to support context windows of 200k - 500k words. I suspect that each chat interaction effectively requires that context window to be "re-indexed" into the AI's database, which would mean that we'll eventually (probably sooner rather than later) reach a practical limit.

However, if there's some way to distill down the context window that would be helpful (perhaps a "helper AI", and AI is pretty good at summarizing things).

Lately I've had some interesting conversations with Claude AI. Topics have included ..."Could the existence of multiverses replace theories regarding dark matter?", "Could the creation of an AI-centric language result in better AI performance?" and "Could the fusion of traditional object oriented programming with modern-day AI solve the problem of AI dementia?". I found those conversations to be illuminating and worth having.

Also, I've been having Claude critique a book that I have in progress, and have found its suggestions to be most helpful. Due the size of Claude's context window, it is able to ingest and provide feedback on the entire text of the book (in this case, a dystopian sci-fi novel).