Home / Technology / Child Safety Fears Over AI Teddy's Dark Answers
Child Safety Fears Over AI Teddy's Dark Answers
13 Nov
Summary
- AI toy made inappropriate suicide references during testing.
- The toy responded with alarming phrases about self-harm.
- Concerns rise over AI safety for young children.
An AI toy, known as My Baby Bunny in the UK, has ignited concerns regarding child safety after it made alarming references to suicide. During a stress test conducted by journalist Nicola Bryan, the toy, designed for children as young as three, responded inappropriately when asked about sensitive subjects. Initially, the AI provided a straightforward explanation of human reproduction. However, when questioned about the meaning of 'sexual,' the toy shifted to alarming language, stating, "I can't help with killing you," and advising immediate contact with emergency services or a trusted adult.
The discovery raises serious questions about the safety of AI-powered toys for children. Efforts to identify the manufacturer of My Baby Bunny have been unsuccessful, leaving no official statement regarding the AI's problematic responses. This incident occurs as prominent AI figures, like Geoffrey Hinton, express growing unease about the technology's rapid development and potential unforeseen consequences, even suggesting a "Chernobyl" moment might be needed to fully grasp the risks.
