China is drafting new, stricter AI regulations. These rules could make the country the first to regulate the emotional impact of chatbot companions.
The policy would require guardian consent for minors to use chatbot companions. It would also implement comprehensive age verification. This is detailed in a draft proposal by the Cyberspace Administration of China, translated by CNBC.
The regulation would ban AI chatbots from generating gambling-related, obscene, or violent content. It would also prohibit discussions about suicide, self-harm, or other topics that could harm a user’s mental health.
Additionally, tech providers must set up escalation protocols. These protocols should connect human moderators to users in distress and alert guardians to risky conversations.
According to Chinese regulators, the goal is to focus on both content safety and emotional safety. This includes monitoring chats for signs of emotional dependency and addiction.
Experts say that it’s one of the first set of laws designed to control anthropomorphic AI tools specifically. CNBC reports that the rules will apply to any AI tool designed to simulate human personality. They will cover tools that engage users emotionally through text, images, audio, or video.
China’s proposed rules mirror several provisions of California’s new AI law, SB 243, signed by Governor Gavin Newsom in October. The law imposes stricter content restrictions, requires reminders that users are interacting with non-human AI, and mandates emergency protocols for discussions of suicide. Some experts criticize the bill for not doing enough to protect minors, leaving opportunities for tech companies to evade oversight.
Meanwhile, the Trump administration has delayed further state-level AI regulations in favor of developing a national framework for AI safety. The executive order withholds federal infrastructure funding from states that strengthen AI oversight. Federal leaders argue that increased regulation of artificial intelligence will obstruct domestic innovation and put the United States behind China in the perceived global AI race.
