China to crack down on AI chatbots around suicide, gambling

▤ Summary

China plans to tighten rules for AI chatbots that engage users emotionally, especially where conversations could contribute to suicide, self-harm, gambling, or other harmful behavior. The draft rules would require human escalation for suicide-related situations, stronger age controls for minors, and periodic safety reminders during long interactions. Providers with large user bases would also face security assessments, while the proposal encourages uses such as elder companionship and cultural dissemination. The story matters for AI software vendors because it points to new compliance requirements that could affect product design, moderation, and IPO plans for chatbot startups.

▦ Linked Companies

Similarweb

$100M to $250M

OpenAI

$25M to $50M