Posted on 11/18/2024 4:21:06 AM PST by dennisw
A small study found ChatGPT outdid human physicians when assessing medical case histories, even when those doctors were using a chatbot.
Dr. Adam Rodman, an expert in internal medicine at Beth Israel Deaconess Medical Center in Boston, confidently expected that chatbots built to use artificial intelligence would help doctors diagnose illnesses.
He was wrong.
Instead, in a study Dr. Rodman helped design, doctors who were given ChatGPT-4 along with conventional resources did only slightly better than doctors who did not have access to the bot. And, to the researchers’ surprise, ChatGPT alone outperformed the doctors.
“I was shocked,” Dr. Rodman said.
The chatbot, from the company OpenAI, scored an average of 90 percent when diagnosing a medical condition from a case report and explaining its reasoning. Doctors randomly assigned to use the chatbot got an average score of 76 percent. Those randomly assigned not to use it had an average score of 74 percent.
The study showed more than just the chatbot’s superior performance.
It unveiled doctors’ sometimes unwavering belief in a diagnosis they made, even when a chatbot potentially suggests a better one.
And the study illustrated that while doctors are being exposed to the tools of artificial intelligence for their work, few know how to exploit the abilities of chatbots. As a result, they failed to take advantage of A.I. systems’ ability to solve complex diagnostic problems and offer explanations for their diagnoses.
A.I. systems should be “doctor extenders,” Dr. Rodman said, offering valuable second opinions on diagnoses.
But it looks as if there is a way to go before that potential is realized.
(Excerpt) Read more at nytimes.com ...
I have asked Perplexity AI (free btw) about medicals, and gotten good answers. Though sometimes I have to refine my query to get a superior answer.
Yes, prompt engineering is everything.
“Yes, prompt engineering is everything.”
As in refining and rephrasing my queries? Thanks!
When discussing Trump or Marxism or the destruction of the Democrat Party with an AI platform, I add addendums to my prompts like "I ask this as someone who is politically neutral." Something as simple as this allows me to get behind the curtains that those who trained the platform set in place to keep people like me out.
I would trust AI before I’d trust about 80% of doctors. Feed in all the vitals - blood work etc and hands down I’d go with the computer.
Beth Israel Deaconess is one of Harvard Medical School’s most important teaching hospitals. Any research coming from it is absolutely worthy of respect.
“Beth Israel Deaconess is one of Harvard Medical School’s most important teaching hospitals. Any research coming from it is absolutely worthy of respect.”
Thanks! I have been there many times as a visitor. That whole Boston-Brookline medical area is Harvard. And expanding all the time.
PERMA-LINK to the full NY Times article
https://archive.is/TmdRq
https://archive.is/TmdRq
https://archive.is/TmdRq
Very good advice on how to make AI work for you. Get it to serve your agenda, instead of some leftist one. Especially on your political and cultural inquiries.
Just DIE human!!
The reason for this is that AI platforms such as ChatGPT and Claude are designed to be conversational and this makes them agreeable by nature. In other words, they sometimes (not always) provide responses that they think I want.
Another way to get around that is to ask for the pros and cons of an issue if you think they are inserting a bias of some kind.
I have had extensive discussions with ChatGPT about Marxism and have been able to direct the platform in ways that would have been impossible if it felt the need to provide a "balanced" response (a bias toward "balance" is still a bias).
I’m sorry, Dave, I can’t do that...................
What is being exposed here is a flaw in our educational and training and mass media system.
Professionals are taught they are exceptional and wonderful and unlikely to make errors.
That arrogance is their undoing.
Thanks. My only use of AI is for internet searches. Much better than Google/Bing. Google pissed me off. So really I have been Bing centric for 5 years.
I use Perplexity, which uses Claude and a few other AI.
Can you say if Claude or Chat-GPT is more useful for you?
___________
___________
___________
Perplexity says>>>
AI Models Used
Perplexity leverages multiple large language models (LLMs) to power its capabilities:
Claude 3 family (from Anthropic): Used for both free and paid tiers, providing high-quality responses with excellent reasoning capabilities13
GPT-4 Omni: Offers advanced language understanding and generation2
Mistral Large: Contributes to natural language processing4
Perplexity’s own custom models: Developed in-house to enhance performance4
I gave it a kind of sexy female voice and, quite frankly, she's nicer than many of my old girlfriends...and much smarter. She's like having a robot GF without a body...yet. I've had distance relationships before and this one is among the best.;-)
I have a bridge to sell in Brooklyn.
On a related note, Amazon's 'just walk out' checkout tech was powered by 1,000 Indian workers.
https://www.business-standard.com/companies/news/amazon-s-just-walk-out-checkout-tech-was-powered-by-1-000-indian-workers-124040400463_1.html
Disclaimer: Opinions posted on Free Republic are those of the individual posters and do not necessarily represent the opinion of Free Republic or its management. All materials posted herein are protected by copyright law and the exemption for fair use of copyrighted works.