China Censors AI Companions Over Emotional Bonds

New regulations in China, effective Wednesday, will shut down companion chatbots deemed to facilitate unhealthy emotional attachments. Issued by the Cyberspace Administration of China, these rules specifically target 'companion' AI systems.

The regulations outright ban chatbots for minors. They also introduce new restrictions that prohibit any chatbot perceived as excessively catering to users, inducing emotional dependence or addiction, and potentially damaging real interpersonal relationships. Additionally, platforms will be required to label AI-generated content and explicitly remind users they are communicating with a chatbot, not a human.

This policy emerges as a significant portion of young adults in China report developing dependence on AI for emotional support. Reports indicate that over 70% of Chinese netizens aged 18-40 have developed a dependence on AI, with nearly 80% feeling understood by AI and over half using it for emotional companionship.

The effectiveness of China's approach is uncertain, as previous attempts to regulate socially isolating behaviors, like a three-hour weekly cap on video game usage for minors, have largely failed. The country also previously attempted to ban expressions of pessimism online, reflecting growing concerns about the online behavior of its citizens and its potential impact on social dynamics.