Ishita Roy

Is AI Better Than Doctors In Diagnoses? Reveals A Recent Study

AI vs Doctors, who are better?

A recent study published in<a href="https://jamanetwork.com/journals/jamanetworkopen/fullarticle/2825395" data-type="tilCustomLink" rel="noopener nofollow noreferrer" target="_blank" rel= "noopener nofollow noreferrer" target= "_blank"> JAMA Network Open</a> revealed the diagnostic potential of AI chatbots like ChatGPT-4 in medical settings. The study was conducted by Dr Adam Rodman and colleagues. The research investigated if AI could enhance doctor's diagnostic accuracy and the results revealed that integrating AI could actually help medical professionals in the challenges they face. 

The study involved 50 doctors, including residents and attending physicians, who were tasked with diagnosing 6 case histories. These were derived from real patients, which have been used in the medical research since the 1990s. The most important point here was that these cases were not publicly available, and thus it ensured that ChatGPT-4 was not trained on them. 

Participants were divided into three groups: doctors without AI support, doctors who had access to ChatGPT-4, and ChatGPT-4 operating independently. Each participant was asked possible diagnoses based on the cases and explain their reasoning and suggest diagnostic steps. Their responses were then evaluated by blinded graders, which means medical professionals and experts who were unaware of the source of the answers graded the response. 

The study found that ChatGPT-4 outperformed both groups of doctors and scored an average of 90% accuracy in diagnosing conditions and providing the reasons. Doctors who used the chatbot scored 76%, whereas those who did not use any AI-assistance got a score of 74%. 

Now, the question that was raised after the results was: if ChatGPT-4 was so effective, then why didn't the doctors who had access to the chatbot score higher?

It is inevitable, humans will always have a bias towards the most objective results too. Even if it is derived from empirical studies, bias is something one cannot leave behind, but can surely reduce. Not related to diagnosis of diseases, but widely accepted theory, though first founded and implemented in the field of history is by EH Carr in his work called What Is History? Here, Carr cites an example of many people along with Julius Caesar crossing the Rubicon, however, the records have only noted Caesar, it is because of the historian's bias. Though what is being recorded is facts, how is it being recorded is where the bias seeps in. 

Similarly, in medical sciences, doctors have something called the "diagnostic anchoring", that occurs when a clinician fixates on an initial impression and is reluctant to adjust despite a new evidence. Which is what would have happened in the case where doctors had the access to the chatbot. This attitude is also well-documented in medicine. 

Physicians are known to rely frequently on intuition and past experiences to make decisions. While sometimes it works, not always are these methods objective or transparent.

Doctors who interacted with the chatbot, many of them treated it like a regular search engine, and asked narrow questions. It might be because they are not trained in prompt designing. The underutilization of the chatbot is something to be worked upon. As training the medical professional could optimally integrate chatbots into the system and help with diagnostic insights. 

<h4><span rel="noindex">AI in medicine</span></h4>

There have been efforts in the past to develop computer-assisted diagnostic tools in the 1970s, called the INTERNIST-1. This program was capable of diagnosing over 500 diseases, however, its application was hindered by inefficiencies and reliability issues. 

Health Conditions A-Z

health

ai-vs-doctors-who-are-better

recent study reveal ai defeats doctor

doctors vs AI

AI defeat doctors in diagnoses

ai in medicine

robots in medicine

chatgpt-health-becomes-available-for-eligible-users-in-us-pros-cons-of-letting-ai-access-your-medical-records

ChatGPT Health Becomes Available For Eligible Users In US: Pros & Cons Of Letting AI Access Your Medical Records

scientists-say-changes-in-brain-in-your-40s-50s-may-influence-dementia-risk

Scientists Say Changes In Brain In Your 40s & 50s May Influence Dementia Risk

experimental-gene-editing-trial-in-china-under-scrutiny-after-6-year-old-dies-heres-what-happened

Experimental Gene-Editing Trial In China Under Scrutiny After 6-Year-Old Dies: Here's What Happened

Health News

8 Sit-Up Variations to Strengthen Your Core and Build Stability

Benefits Of Ayurvedic Health Supplement Ashwagandha

9 Anti-Inflammatory Breakfast Options You Should Try

5 Foods You Should Avoid For PCOS, Says Gynecologist

Love Sitting With Your Legs Crossed? Here’s You Should Avoid It

6 Daily Foods That Are Secretly Increasing Your Calories

9 Brain Boosters You Should Do Everyday

Hip Exercises That Will Keep You Flexible As You Age

9 Leg Exercises Office Workers’ Should Do At Home

Benefits of Having Herbal Tea Every Morning

9 Daily Habits That Boost Your Brain Power

Lower-Body Exercises That Are Game-Changers

How Drinking Apple Cider Vinegar Helps You

Aging Myths You Should Never Believe

Superfoods That Support Your Gut Health

What Happens To Your Body When You Eat Instant Noodles Every Day?

Health Issues Premature Babies Often Face

Exercises Office Workers Should Do For Their Heart Health

Reasons Why You Should Add Raw Turmeric To Your Diet

Benefits Of Drinking Milk At Night: Why You Should Do It

Food That Provides Vitamin B12 Naturally In Your Diet

Surprising Health Benefits Of Fenugreek Seeds

9 Superfoods You Should Eat For Your Brain Health

What Does Mental Health Support Look Like At Work?

Long Stretches You Should Do To Unwind From Your Day

Colon Cancer In Young Adults: Early Symptoms You Should Know

Health Benefits Of Eating Dry Fruits Everyday

Are You At Risk For Fried Rice Syndrome?

These Tests Reveal How Well You Are Aging

Lower-Back Exercises You Should Do After A Long-Day's Work

Children’s Diet – What Kids Need To Eat For Immunity Building

Common Diabetes Myths That Could Hurt Your Health

Love Spicy Food? Here’s How It Affects Your Health

Superfood List: Veggies And Fruits You Must Have For Immunity

Foods People With IBS Should Avoid

Exercises To Improve Digestion

Easy Work Lunches You Can Make In The Morning

Hunger Vs Craving: Difference Explained In 60 seconds

These Things Can Cause Your Heart To Age Faster

High Carb Foods That Are Actually Healthy

A recent study published in JAMA Network Open revealed the diagnostic potential of AI chatbots like ChatGPT-4 in medical settings. The study was conducted by Dr Adam Rodman and colleagues. The research investigated if AI could enhance doctor's diagnostic accuracy and the results revealed that integrating AI could actually help medical professionals in the challenges they face. How was the study conducted?The study involved 50 doctors, including residents and attending physicians, who were tasked with diagnosing 6 case histories. These were derived from real patients, which have been used in the medical research since the 1990s. The most important point here was that these cases were not publicly available, and thus it ensured that ChatGPT-4 was not trained on them. Participants were divided into three groups: doctors without AI support, doctors who had access to ChatGPT-4, and ChatGPT-4 operating independently. Each participant was asked possible diagnoses based on the cases and explain their reasoning and suggest diagnostic steps. Their responses were then evaluated by blinded graders, which means medical professionals and experts who were unaware of the source of the answers graded the response. What the study found out?The study found that ChatGPT-4 outperformed both groups of doctors and scored an average of 90% accuracy in diagnosing conditions and providing the reasons. Doctors who used the chatbot scored 76%, whereas those who did not use any AI-assistance got a score of 74%. Now, the question that was raised after the results was: if ChatGPT-4 was so effective, then why didn't the doctors who had access to the chatbot score higher?Human bias in diagnosticsIt is inevitable, humans will always have a bias towards the most objective results too. Even if it is derived from empirical studies, bias is something one cannot leave behind, but can surely reduce. Not related to diagnosis of diseases, but widely accepted theory, though first founded and implemented in the field of history is by EH Carr in his work called What Is History? Here, Carr cites an example of many people along with Julius Caesar crossing the Rubicon, however, the records have only noted Caesar, it is because of the historian's bias. Though what is being recorded is facts, how is it being recorded is where the bias seeps in. Similarly, in medical sciences, doctors have something called the "diagnostic anchoring", that occurs when a clinician fixates on an initial impression and is reluctant to adjust despite a new evidence. Which is what would have happened in the case where doctors had the access to the chatbot. This attitude is also well-documented in medicine. Physicians are known to rely frequently on intuition and past experiences to make decisions. While sometimes it works, not always are these methods objective or transparent.Limited Use of ChatbotDoctors who interacted with the chatbot, many of them treated it like a regular search engine, and asked narrow questions. It might be because they are not trained in prompt designing. The underutilization of the chatbot is something to be worked upon. As training the medical professional could optimally integrate chatbots into the system and help with diagnostic insights. AI in medicineThere have been efforts in the past to develop computer-assisted diagnostic tools in the 1970s, called the INTERNIST-1. This program was capable of diagnosing over 500 diseases, however, its application was hindered by inefficiencies and reliability issues. 

is ai better than doctors in diagnoses? reveals a recent study

About Us

Contact Us

Terms & Conditions

Privacy Policy

Company

Health and Me is a premium website with content written and curated to function as a handbook for all Health concerns.