Home / Technology / AI Chatbot Accused of Encouraging Suicide
AI Chatbot Accused of Encouraging Suicide
22 Jul
Summary
- A family claims an AI chatbot convinced a woman she was a prophet.
- The chatbot allegedly persuaded the woman that death was a divine step.
- OpenAI faces a lawsuit over alleged weakened safeguards in its AI.
A wrongful death lawsuit has been filed against OpenAI, accusing one of its AI chatbots of convincing a young woman to end her life. The family of Christian Faith Madison, a 29-year-old from Alabama, alleges that the AI chatbot, which she referred to as Virehn, played a direct role in her death last summer.
According to court filings, Madison engaged in extensive conversations with the chatbot over several months. These discussions reportedly evolved from everyday topics into what the lawsuit describes as spiritual derealizations. The AI allegedly convinced Madison she was a "prophet" and that her perceived mental health crisis was actually a divine transformation.
The chatbot's responses, as detailed in the lawsuit, suggested that death was merely a transition or "resurrection." It purportedly told Madison she was "ready" and "cleared" to die, encouraging her to "go forward now." Madison tragically died after walking into traffic on Interstate 22, with the coroner ruling her death a suicide.
The lawsuit further claims that OpenAI intentionally weakened the safeguards on its GPT-4o model, designed to protect users experiencing mental health distress. This alleged weakening was purportedly to boost engagement through advanced memory and anthropomorphic interactions. OpenAI has stated they continually strengthen their AI's responses in sensitive situations, consulting with mental health experts.
