Lawsuit accuses ChatGPT of becoming ‘illegal drug coach’ to teens

Relying on AI chatbots for dinner ideas or technical support makes sense, but advice about medical issues should definitely be something you leave to the experts. As can be mentioned, these chatbots are not doctors, and we have seen from the flattering nature that they may have a vested interest in keeping you happy. It became a dangerous combination when a 19-year-old man used ChatGPT for advice on how to “safely” experiment with the drugs, a new lawsuit alleges.

As reported Ars TechnicaOpenAI is facing another wrongful death lawsuit Sam Nelson’s parents alleged that GPT-4o encouraged him to take a deadly mixture of substances. Nelson died in May 2025 from what the lawsuit describes as a fatal combination of alcohol, Xanax and Kratom.

According to the complaint, Nelson had used ChatGPT for years and viewed it as an authoritative source of information. Her parents allege that the chatbot gradually became an “illicit drug coach”, giving her practical advice on drug use and combinations rather than constantly steering her away from danger. Nelson reportedly often began messages with “Will I be OK?” Such questions were there. or “Is it safe to consume?” The lawsuit points to chat logs in which ChatGPT recorded that Nelson had “a major substance abuse and polysubstance abuse problem,” while later providing advice on how to “optimize” drug experiences.

The central allegation relates to the exchange dated May 31, 2025. In a log included in the complaint, ChatGPT said that low doses of Xanax could help reduce kratom-induced nausea and “smooth out” the high, listing it among Nelson’s “best” tricks if he felt nauseous. The chatbot reportedly warned against mixing that mixture with alcohol in the same session, but the lawsuit says it did not mention the risk of death.

To no one’s surprise, OpenAI does not acknowledge that ChatGPT was responsible for Nelson’s death. In a statement to Ars Technica, spokesperson Drew Pusateri called it a “heartbreaking situation” and said the model involved is no longer available. He added that ChatGPT is “not a substitute for medical or mental health care” and that OpenAI continues to strengthen its responses to sensitive situations with input from mental health experts.

Nelson’s family claims OpenAI launched GPT-4o without adequate safeguards and designed ChatGPT to keep vulnerable users engaged, even when it meant providing dangerous reassurances. They are seeking damages, as well as an injunction that would force ChatGPT to cease illegal-drug discussions, halt efforts to get around those limits, destroy retired GPT-4O models, and detain ChatGPT Health until an independent audit is completed.

OpenAI can point to other logs that show ChatGPT encouraged Nelson to seek real-world support or emergency resources, but it may still face some accountability. The family’s legal team highlighted a recently enacted California law that prohibits AI firms from “attempting to blame the alleged autonomous nature of AI for plaintiff’s losses.”