ChatGPT diagnosed a boy’s rare condition!
A study published last month by researchers at Mass General Brigham in Boston found ChatGPT found the correct diagnosis 72 percent of the time, about the same rate as a resident doctor. More senior doctors are usually right about 95 percent of the time, experts suggest.
Additionally, a study published earlier this year found that ChatGPT could pass the country’s gold-standard medical exam, the three-part Medical Licensing Exam (USMLE), scoring between 52.4 and 75 percent.
The passing threshold is about 60 percent.
https://www.dailymail.co.uk/health/article-12509111/ChatGPT-diagnosis-rare-condition.html
ChatGPT might be worth consulting for a second opinion if one gets a young doctor.
Beware of merely passing licensing exam thresholds. I’m in a line of work that requires certification, and 200 hours of training time every 3 years. Everyone in our group has to pass, or they don’t gt to to the various jobs that require the certification.
But, from experience, passing the test isn’t the same thing as being very good at what you do. I mean, it helps but there are plenty of questionable or mediocre people out there with credentials.
I say that because I think that we pay way too much attention to certifications and too little to common sense sometimes. That ChatGPT can pass a medical licensing exam is something of an accomplishment, but keep in mind that there are many good - and poor - doctors out there with the same certification.