Free Republic
Browse · Search
General/Chat
Topics · Post Article

Skip to comments.

Digital Dementia? AI Shows Surprising Signs of Cognitive Decline
SciTech Daily ^ | 12/18/2024

Posted on 12/21/2024 6:39:53 AM PST by BenLurkin

Almost all leading large language models, or “chatbots,” show signs of mild cognitive impairment when tested using assessments commonly used to detect early dementia, according to a study published in the Christmas issue of The BMJ.

The study also found that older versions of these chatbots, much like aging human patients, performed worse on the tests. The authors suggest that these findings “challenge the assumption that artificial intelligence will soon replace human doctors.”

The instructions given to the LLMs for each task were the same as those given to human patients. Scoring followed official guidelines and was evaluated by a practicing neurologist.

ChatGPT 4o achieved the highest score on the MoCA test (26 out of 30), followed by ChatGPT 4 and Claude (25 out of 30), with Gemini 1.0 scoring lowest (16 out of 30).

Challenges in Visual and Executive Functions

All chatbots showed poor performance in visuospatial skills and executive tasks, such as the trail-making task (connecting encircled numbers and letters in ascending order) and the clock drawing test (drawing a clock face showing a specific time). Gemini models failed at the delayed recall task (remembering a five-word sequence).

Most other tasks, including naming, attention, language, and abstraction were performed well by all chatbots.

(Excerpt) Read more at scitechdaily.com ...


TOPICS: Computers/Internet
KEYWORDS: artifishalinteligenz; cognitivedecline; digitaldementia
Navigation: use the links below to view more comments.
first 1-2021-36 next last

1 posted on 12/21/2024 6:39:53 AM PST by BenLurkin
[ Post Reply | Private Reply | View Replies]

To: BenLurkin

Most other tasks, including naming, attention, language, and abstraction were performed well by all chatbots.


think about that.......................

problem solving, not so much.


2 posted on 12/21/2024 6:45:59 AM PST by PeterPrinciple (Thinking Caps are not longer being issued, but there must be a warehouse full of them somewhere)
[ Post Reply | Private Reply | To 1 | View Replies]

To: BenLurkin

If AI learns from us, & we are aging & declining mentally, it stands to reason that the same would happen to AI. ;-)


3 posted on 12/21/2024 6:46:10 AM PST by Twotone ( What's the difference between a politician & a flying pig? The letter "F.")
[ Post Reply | Private Reply | To 1 | View Replies]

To: Twotone

Yup—it is because AI has been programmed by folks who believe in equity—so AI must learn to be as dumb as the dumbest humans.


4 posted on 12/21/2024 6:48:16 AM PST by cgbg (It is time to pull the Deep State out of the mass media--like ticks from a dog.)
[ Post Reply | Private Reply | To 3 | View Replies]

To: BenLurkin

Seems like there’s a difference between learning and discernment... well, duh.


5 posted on 12/21/2024 6:48:20 AM PST by HombreSecreto (The life of a repo man is always intense)
[ Post Reply | Private Reply | To 1 | View Replies]

To: BenLurkin

They need to develop AI that can forget useless information.


6 posted on 12/21/2024 6:49:06 AM PST by wildcard_redneck
[ Post Reply | Private Reply | To 1 | View Replies]

To: wildcard_redneck

“They need to develop AI that can forget useless information.”

People may need to develop the ability to forget useless information...but who decides what information is useless and how do they do it?


7 posted on 12/21/2024 6:57:27 AM PST by KrisKrinkle (c)
[ Post Reply | Private Reply | To 6 | View Replies]

To: BenLurkin

I use Microsoft’s Copilot often, but only as a super power search engine, to provide me with resources that MIGHT support Copilot’s responses to my questions. Some of the website links that Copilot suggests are totally irrelevant to my questions, but it does a goood job of chcking my spelllling and also my grammmer too...


8 posted on 12/21/2024 7:01:37 AM PST by Deaf and Discerning
[ Post Reply | Private Reply | To 1 | View Replies]

To: BenLurkin

I don’t think I have EVER connected to a customer service chat line to help me with something and have the chatbot actually help, but normally you have to go through the chatbot to get to a human who can help you.


9 posted on 12/21/2024 7:03:42 AM PST by libertylover (Our biggest problem, by far, is that almost all of big media is AGENDA-DRIVEN, not-truth driven.)
[ Post Reply | Private Reply | To 1 | View Replies]

To: KrisKrinkle

There are lots of psychological studies on how the brain both memorizes and forgets information. They just need to incorporate an approximate method to purge the datasets.


10 posted on 12/21/2024 7:05:07 AM PST by wildcard_redneck
[ Post Reply | Private Reply | To 7 | View Replies]

To: wildcard_redneck

They just need to incorporate an approximate method to purge the datasets.


and who is they?


11 posted on 12/21/2024 7:07:44 AM PST by PeterPrinciple (Thinking Caps are not longer being issued, but there must be a warehouse full of them somewhere)
[ Post Reply | Private Reply | To 10 | View Replies]

To: PeterPrinciple

“and who is they?”

The AI developers, you know, the people that invented AI. I’m still trying to figure out if your question was snark or just a brain fart.


12 posted on 12/21/2024 7:09:34 AM PST by wildcard_redneck
[ Post Reply | Private Reply | To 11 | View Replies]

To: BenLurkin

If they “knew” as much of the mass-time-dimension facts as did Albert, could they ever deduce the concept that light shows the special inescapable relationship between mass and power?


13 posted on 12/21/2024 7:14:59 AM PST by imardmd1 (To learn is to live; the joy of living: to teach. Fiat Lux!)
[ Post Reply | Private Reply | To 1 | View Replies]

To: BenLurkin

“The study also found that older versions of these chatbots, much like aging human patients, performed worse on the tests.”

This is what passes for journalism now. The quote implies that any given chatbot loses ability with time (”much like aging human patients”) instead of simply stating that newer ones are more advanced and score higher.


14 posted on 12/21/2024 7:18:10 AM PST by coloradan (They're not the mainstream media, they're the gaslight media. It's what they do. )
[ Post Reply | Private Reply | To 1 | View Replies]

To: BenLurkin

Maybe the problem is knowledge without intellect, a which has always been attributed solely to God, angels and humans. I never thought that inanimate human creations could truly reason, no matter how many processors or how fast the clock speed.
Interestingly, I watched a documentary on YouTube last week comparing NASA and SpaceX. I figured it must have been AI generated when it referred to a NASA official receiving an email in 1966.


15 posted on 12/21/2024 7:18:45 AM PST by I-ambush (From the brightest star comes the blackest hole. You had so much to offer, why didya offer your sou?)
[ Post Reply | Private Reply | To 1 | View Replies]

To: wildcard_redneck; PeterPrinciple

Programmed by fellows of compassion and vision
We’ll be free when their work is done
We’ll be eternally free, yes, and eternally young
What a beautiful world it will be
What a glorious time to be free


16 posted on 12/21/2024 7:22:51 AM PST by Ignatz (The bees don't bother to tell the flies that honey tastes better than dung.)
[ Post Reply | Private Reply | To 12 | View Replies]

To: BenLurkin
Almost all leading large language models, or “chatbots,”

Well. Isn't that interesting.

Once their new god is failing they admit what I have been saying all along.

It is not AI.

I am shocked.

17 posted on 12/21/2024 7:24:13 AM PST by Harmless Teddy Bear ( Not my circus. Not my monkeys. But I can pick out the clowns at 100 yards.)
[ Post Reply | Private Reply | To 1 | View Replies]

To: Ignatz

Yeah, i don’t trust AI either. Like all new technologies it will first be used to kill and abuse the populations of earth before it gets democratized by widespread use. When it comes to science I’m excited for AI but when it comes to its impact on society and our civilization I am a skeptic.


18 posted on 12/21/2024 7:26:13 AM PST by wildcard_redneck
[ Post Reply | Private Reply | To 16 | View Replies]

To: BenLurkin
Are the older versions performing worse than they did last year? That would indicate cognitive decline. Or do the older models performing worse than the newer models? That would indicate cognitive improvement, like comparing results from a five year old versus a six year old. The six year olds do better, but that is not evidence of the five year olds suffering from a decline.

Maybe the neurologists giving the tests are the ones suffering from a decline by not discussing that.

19 posted on 12/21/2024 7:26:23 AM PST by KarlInOhio (Now unburdened by the Biden/Harris administration that has been.)
[ Post Reply | Private Reply | To 1 | View Replies]

To: KrisKrinkle
People may need to develop the ability to forget useless information...but who decides what information is useless and how do they do it?

People already do.

And we spend a great deal of brain power on filtering out information.

20 posted on 12/21/2024 7:26:59 AM PST by Harmless Teddy Bear ( Not my circus. Not my monkeys. But I can pick out the clowns at 100 yards.)
[ Post Reply | Private Reply | To 7 | View Replies]


Navigation: use the links below to view more comments.
first 1-2021-36 next last

Disclaimer: Opinions posted on Free Republic are those of the individual posters and do not necessarily represent the opinion of Free Republic or its management. All materials posted herein are protected by copyright law and the exemption for fair use of copyrighted works.

Free Republic
Browse · Search
General/Chat
Topics · Post Article

FreeRepublic, LLC, PO BOX 9771, FRESNO, CA 93794
FreeRepublic.com is powered by software copyright 2000-2008 John Robinson