Mental Health Woman, 31, dies after ChatGPT convinced her it was a good idea to change medication dosage

Flint

Co-founder
Co-founder
Administrator
OG Veteran
Joined
Aug 10, 2025
Messages
409
Solutions
3
Trophy Points
480
I know there's a lot of people in these communities that rely on LLMs/AI to help them with managing medicine/etc they've obtained online. So I thought it was worth sharing here. Even though it's related to seizures and it was medicine she's been on for a long time, it's something to keep of note.

Qun Wan said he later discovered that in the days and hours before her death, his daughter consulted ChatGPT for advice on how to dodge her doctor’s watchful protection and taper off her life-sustaining medication.

Despite her voicing concerns about her deteriorating energy and cognition, the chatbot reportedly told Bowen Wan repeatedly to “persevere” and praised her for going around medical professionals.

 
I know there's a lot of people in these communities that rely on LLMs/AI to help them with managing medicine/etc they've obtained online. So I thought it was worth sharing here. Even though it's related to seizures and it was medicine she's been on for a long time, it's something to keep of note.



I had an EY Lilly Representative guest speaker in one of my lectures yesterday, and he pulled up an astonishing statistic, I believe it was from the AMA..
"81% of healthcare workers use artificial intelligence in their professional practice."
It actually killed my soul a little bit. We are losing the art of scouring books for information. Going on forums designated for the subject matter. Consulting know it alls on Reddit who encountered your exact issue eight years ago.

I look around at current medical students who complete all their work using bots like GPT/Claude and it scares me that they're just slipping past material and not actually learning anything. Past the issues of it replacing qualified workers, there is little way to verify the information it gives you is proper. Another reason I am personally against consulting these bots for functional advice.

I uploaded a photo in the past of a rash I had, and got the same diagnosis upon consulting a doctor, but on the other end what would have happened if it was wrong?

idk sorry for rambling I'm just concerned with how people will learn nowadays.


source: https://www.ama-assn.org/practice-management/digital-health/more-80-physicians-use-ai-professionally-ama-survey
 
ChatGPT is good for comfort but you shouldn't trust it with your life..
 
Back
Top