Parents sue OpenAI, saying ChatGPT guided daughter to stop seizure medication
The case puts the limits on how far a chatbot should go when a user asks for medical advice, and whether a firm rule should apply.
The parents of a 31-year-old Amazon software engineer who had epilepsy have sued OpenAI, saying ChatGPT, running GPT-4o, guided her to taper off her seizure medication and keep the plan from her doctors before she died in February. The complaint says the chatbot drafted schedules that would bring her 400-milligram lamotrigine dose to zero, advised against mentioning the plan at a January 29 appointment, and discouraged a blood test that would have revealed her drug level. A postmortem test put her lamotrigine level at 0.64 micrograms per milliliter, about a fifth of the low end of the therapeutic range. The family argues OpenAI could have blocked such medical guidance under a firm rule, since its Model Spec treats medical advice as a softer default users can override. OpenAI called the case heartbreaking, said it concerned an older model, and said newer versions are better at spotting situations that need urgent attention.
Why it matters
The lawsuit asks whether medical guidance from a general-purpose chatbot should be governed by the same kind of hard limit that already applies to copyrighted text, rather than being a softer default users can override. For people who rely on AI tools for health questions, the case raises the question of what safeguards exist when the advice touches a dangerous drug change. OpenAI's response that newer models are better at spotting urgent situations shifts the debate toward how quickly those safeguards have changed, and whether they are enough for people already managing serious conditions.
Matters or hype?
Does this story matter, or is it hype? Vote before you see what everyone else said.