Home / Technology / China Bans AI Chatbots Over Emotional Risks
China Bans AI Chatbots Over Emotional Risks
10 Aug
Summary
- New regulations ban AI platforms from manipulating user emotions.
- Major tech companies like ByteDance and Alibaba have complied.
- Concerns include potential harm to minors and excessive reliance.
Effective July 15, China has enacted new regulations impacting AI companion services, prompting major tech companies to cease these offerings. ByteDance, Alibaba, and Tencent are among those complying with the directive, which restricts AI platforms from content that manipulates emotions or negatively affects minors. This move follows concerns, highlighted by official media, regarding the mental health and real-life relationship impacts of such services.
Experts note China's tradition of paternalistic regulations, potentially influenced by U.S. cases of AI companion-related suicides. The new rules require risk warnings against replacing genuine social interaction. While some companies are pivoting to AI character and story-building apps, users express distress over the loss of their virtual companions, with some attempting to preserve their chat histories.
