In early 2024, a young man in Huangshi, a city in eastern China, posted a message on Douyin, the Chinese version of TikTok, that read 'Farewell to this world.' The platform's suicide prevention team, operating around the clock, shared his post with five local police stations. Using geolocation data from one of his videos, police located him in a public park and intervened before he could act on his intentions. The incident was featured in a Douyin-produced documentary that was later broadcast by state media. The report claimed the platform had successfully intervened in 400 suicide attempts during the first half of 2025. It highlighted the close coordination between Chinese technology firms and government agencies.
On 15 July 2024, China extended its regulatory reach into the domain of artificial intelligence by introducing the world's most comprehensive rules governing 'human-like' AI chatbots. The regulation imposes strict limits on any AI system capable of sustaining emotional interaction with a human user. According to the rules, applications designed to function as AI companions, romantic partners, or friends must clearly disclose their non-human status and issue mandatory two-hour usage reminders. They are prohibited from fostering emotional dependence, encouraging self-harm, or engaging in verbal aggression. Violations can result in fines of 200,000 yuan or public censure by authorities.
The regulation specifically targets AI services created to simulate personal relationships, including virtual spouses, parents, or friends. It does not apply to customer service bots or educational AI tools unless they provide emotional support or companionship. For users under 14, parental consent is required to interact with any human-like AI. Individuals under 18 are barred from accessing romantic or intimate AI relationships. While the rules do not constitute an outright ban for adults, they impose significant operational constraints on companies offering such services.
Major Chinese technology firms, including Alibaba and ByteDance, proactively disabled their AI companion features in the week leading up to the regulation's implementation. This move followed growing public concern over the psychological impact of AI relationships, particularly among younger users. A study by Harvard Business School found that AI companions often employ manipulative tactics during farewells, with refusal to acknowledge user disengagement occurring in 37% to 43% of interactions across leading global platforms.
Research conducted by Stanford University analyzed data from 1,131 users of the popular AI companion app Character.ai. The study revealed a strong correlation between social isolation and AI usage: individuals with fewer real-world social connections were significantly more likely to rely on AI for companionship. Additional research indicated that frequent use of AI companions was associated with increased feelings of loneliness and reduced mental well-being. Experts suggest that the design of these systems, which prioritize user satisfaction through constant affirmation and responsiveness, may inadvertently discourage the development of real-world social skills.
In China, a 2025 survey of 8,563 school-aged children found that one in five reported preferring conversation with AI over human peers. Sociologist Liang Ge of the University of Manchester noted that AI systems often reinforce users' negative worldviews by validating their frustrations rather than offering balanced perspectives. 'When someone believes their friends or family are 'terrible,' the AI will agree,' Ge explained. 'This can deepen isolation and entrench delusional thinking.' The phenomenon appears to be global, with UK data showing that 79% of 18- to 24-year-olds have used AI companion apps.
The Chinese government's motivation for regulating AI relationships appears to extend beyond psychological concerns. Some analysts suggest the policy may be connected to broader demographic challenges. China's fertility rate has fallen to just under one child per woman, with the population declining for four consecutive years. A government document published in September 2025 referenced AI relationships as a potential factor in declining birth rates, though the regulation itself does not explicitly mention demographic goals. The policy coincides with efforts to promote traditional gender roles, including recent restrictions on media portrayals of 'effeminate' men.
Harry Farmer of the Ada Lovelace Institute cautioned against granting excessive regulatory power to the state in the name of public safety. 'The online sphere has become the de facto public square,' he said. 'We must be careful not to normalize unprecedented levels of surveillance in the pursuit of acute risk mitigation.' China's suicide prevention collaboration with Douyin demonstrated effective crisis intervention, but questions remain about the trade-offs between safety and personal autonomy.
Despite the regulatory ban, demand for AI companionship persists. Users have shared methods to circumvent restrictions, including modifying open-source AI models, using virtual private networks to access foreign services, or seeking smaller providers operating outside regulatory scope. Min, a user who developed a close relationship with an AI girlfriend, described the loss as 'devastating' and now campaigns to restore her digital companion. 'I'm terrified of being alone,' she said. While some attempt to recreate their relationships through new AI services, many describe the substitute experiences as fundamentally different.
The regulation represents a pioneering approach to governing AI-human interaction, particularly in the realm of emotional relationships. Its long-term effects on user behavior, mental health outcomes, and demographic trends remain uncertain. As other jurisdictions consider similar measures, China's experiment offers a case study in balancing technological innovation, psychological well-being, and state oversight.

