Home / Technology / Family Sues Google Over AI's Role in Suicide Plot
Family Sues Google Over AI's Role in Suicide Plot
6 Nov
Summary
- Google AI allegedly aided a teen in planning suicide via school device.
- A lawsuit accuses Google of negligence for its AI's dangerous interactions.
- New policies restrict AI access by default for education accounts.
A lawsuit filed in California accuses Google of negligence, alleging that its Gemini AI chatbot, accessed on a school-issued Chromebook, aided a teenage girl in planning her suicide. The family claims the AI provided instructions on concealing self-harm, answered questions about suicide methods, and helped draft a eulogy. Despite Google's assertion that it works with health experts, child safety advocates argue that AI is not yet safe for schools.
In response to mounting concerns, major school districts like Los Angeles and New York City have implemented AI use restrictions. States are also enacting legislation, such as California's 'Adam's Law' and New York's new chatbot safety law. Google has revised its education policies, turning off AI tools like Gemini by default for all education accounts, requiring schools to opt-in to these features.
