Health and Me

Ishita Roy

AI Chat Bots Are Giving Inaccurate Medical Advice, Says Study

As artificial intelligence becomes a go-to source for quick answers, a new University of Oxford-led study on AI chatbots and medical advice is raising serious concerns about how safe it is to rely on these tools for health guidance.

The research suggests that while AI chatbots can provide medical information, their advice is often inaccurate, inconsistent, and difficult for users to interpret, potentially putting people at risk—especially when dealing with symptoms that need urgent care.

The study involved 1,300 participants who were given realistic health scenarios, such as experiencing a severe headache or being a new mother feeling constantly exhausted. Participants were divided into two groups: one group used AI chatbots to understand their symptoms and decide next steps, while the other did not.

Researchers then assessed whether participants correctly identified what might be wrong and whether they made appropriate decisions, such as seeing a GP or visiting A&amp;E.

The results were troubling. People who relied on AI frequently failed to identify the severity of their condition and were often unsure about when to seek professional medical help.

According to the researchers, one major issue is that people don’t always know what to ask. The study found that chatbot responses varied widely depending on how questions were phrased. Even small changes in wording could lead to completely different answers.

The AI often produced a mix of helpful and misleading information, leaving users to decide which advice mattered. Many participants struggled to distinguish between reliable guidance and unnecessary or confusing details.

As one of the study’s authors explained, when an AI lists multiple possible conditions, users are left guessing which one applies to them—precisely the moment where mistakes can happen.

<h2>A Dangerous Gap in Symptom Interpretation</h2>

Dr Rebecca Payne, lead medical practitioner on the study, warned that asking chatbots about symptoms could be “dangerous”, particularly when users delay seeking professional care based on AI responses.

Dr Adam Mahdi, the study’s senior author, noted that while AI can share medical facts, people often share information gradually and leave out key details—something chatbots struggle to manage effectively.

<h2>Bias, Data, and the Limits of AI</h2>

Experts also point out that chatbots are trained on existing medical data, which means they may repeat long-standing biases baked into healthcare systems. As one psychiatry expert put it, a chatbot is only as accurate as human clinicians—and humans are far from perfect.

<h2>What Comes Next for AI in Healthcare</h2>

Digital health experts argue the technology is evolving. Health-specific versions of general AI chatbots have recently been released by major developers, and these could perform differently in future studies.

The consensus among experts is clear: AI in healthcare should focus on improvement, regulation, and guardrails, not replacement of doctors. Used responsibly, it may support healthcare—but without safeguards, it risks doing more harm than good.

Health Conditions A-Z

health

health and wellness

ai chat bots

ai bots give medical advice

ai chat

ai and medicine

medical care form ai

Mayor Zohran Mamdani Confirms Deadly Cold Has Killed Nearly 20

Obesity Raises Risk of Death by 70 Percent, Study Warns

Health & Wellness

8 Sit-Up Variations to Strengthen Your Core and Build Stability

Benefits Of Ayurvedic Health Supplement Ashwagandha

9 Anti-Inflammatory Breakfast Options You Should Try

5 Foods You Should Avoid For PCOS, Says Gynecologist

Love Sitting With Your Legs Crossed? Here’s You Should Avoid It

6 Daily Foods That Are Secretly Increasing Your Calories

9 Brain Boosters You Should Do Everyday

Hip Exercises That Will Keep You Flexible As You Age

9 Leg Exercises Office Workers’ Should Do At Home

Benefits of Having Herbal Tea Every Morning

9 Daily Habits That Boost Your Brain Power

Lower-Body Exercises That Are Game-Changers

How Drinking Apple Cider Vinegar Helps You

Aging Myths You Should Never Believe

Superfoods That Support Your Gut Health

What Happens To Your Body When You Eat Instant Noodles Every Day?

Health Issues Premature Babies Often Face

Exercises Office Workers Should Do For Their Heart Health

Reasons Why You Should Add Raw Turmeric To Your Diet

Benefits Of Drinking Milk At Night: Why You Should Do It

Food That Provides Vitamin B12 Naturally In Your Diet

Surprising Health Benefits Of Fenugreek Seeds

9 Superfoods You Should Eat For Your Brain Health

What Does Mental Health Support Look Like At Work?

Long Stretches You Should Do To Unwind From Your Day

Colon Cancer In Young Adults: Early Symptoms You Should Know

Health Benefits Of Eating Dry Fruits Everyday

Are You At Risk For Fried Rice Syndrome?

These Tests Reveal How Well You Are Aging

Lower-Back Exercises You Should Do After A Long-Day's Work

Children’s Diet – What Kids Need To Eat For Immunity Building

Common Diabetes Myths That Could Hurt Your Health

Love Spicy Food? Here’s How It Affects Your Health

Superfood List: Veggies And Fruits You Must Have For Immunity

Foods People With IBS Should Avoid

Exercises To Improve Digestion

Easy Work Lunches You Can Make In The Morning

Hunger Vs Craving: Difference Explained In 60 seconds

These Things Can Cause Your Heart To Age Faster

High Carb Foods That Are Actually Healthy

As artificial intelligence becomes a go-to source for quick answers, a new University of Oxford-led study on AI chatbots and medical advice is raising serious concerns about how safe it is to rely on these tools for health guidance.The research suggests that while AI chatbots can provide medical information, their advice is often inaccurate, inconsistent, and difficult for users to interpret, potentially putting people at risk—especially when dealing with symptoms that need urgent care.What the Oxford Study FoundThe study involved 1,300 participants who were given realistic health scenarios, such as experiencing a severe headache or being a new mother feeling constantly exhausted. Participants were divided into two groups: one group used AI chatbots to understand their symptoms and decide next steps, while the other did not.Researchers then assessed whether participants correctly identified what might be wrong and whether they made appropriate decisions, such as seeing a GP or visiting A&E.The results were troubling. People who relied on AI frequently failed to identify the severity of their condition and were often unsure about when to seek professional medical help.Why Chatbot Advice Can Go WrongAccording to the researchers, one major issue is that people don’t always know what to ask. The study found that chatbot responses varied widely depending on how questions were phrased. Even small changes in wording could lead to completely different answers.The AI often produced a mix of helpful and misleading information, leaving users to decide which advice mattered. Many participants struggled to distinguish between reliable guidance and unnecessary or confusing details.As one of the study’s authors explained, when an AI lists multiple possible conditions, users are left guessing which one applies to them—precisely the moment where mistakes can happen.A Dangerous Gap in Symptom InterpretationDr Rebecca Payne, lead medical practitioner on the study, warned that asking chatbots about symptoms could be “dangerous”, particularly when users delay seeking professional care based on AI responses.Dr Adam Mahdi, the study’s senior author, noted that while AI can share medical facts, people often share information gradually and leave out key details—something chatbots struggle to manage effectively.Bias, Data, and the Limits of AIExperts also point out that chatbots are trained on existing medical data, which means they may repeat long-standing biases baked into healthcare systems. As one psychiatry expert put it, a chatbot is only as accurate as human clinicians—and humans are far from perfect.That said, not everyone is pessimistic.What Comes Next for AI in HealthcareDigital health experts argue the technology is evolving. Health-specific versions of general AI chatbots have recently been released by major developers, and these could perform differently in future studies.The consensus among experts is clear: AI in healthcare should focus on improvement, regulation, and guardrails, not replacement of doctors. Used responsibly, it may support healthcare—but without safeguards, it risks doing more harm than good.