🔗 Share this article

Officials in China have proposed comprehensive draft guidelines for artificial intelligence designed to provide strong measures for minors and stop AI assistants from providing counsel that could encourage suicide.

Under the draft framework, developers will also be obligated to ensure their systems do not generate content that encourages gambling.

A Response to Fast-Paced Expansion

This oversight proposal arrives amidst a significant increase in the launch of chatbots being launched within China and worldwide.

Once enacted, these measures will apply to AI products and services available in China, constituting a significant effort to oversee the fast-growing technology, which has been subject to intense concern over user safety issues this year.

Central Provisions of the Proposed Rules

The released proposed regulations include several requirements specifically designed for safeguarding minors. These measures include directing AI providers to:

• Supply personalised settings.
• Enforce usage caps on use.
• Obtain consent from legal custodians prior to delivering emotional companionship support.

Furthermore AI service providers have to have a live agent assume control of any interaction concerning suicide and immediately inform the user's parent.

Companies must ensure their platforms do not generate information that endangers public security, harms national honour, or weakens national unity.

Balancing Development and Safety

The regulatory body noted that it promotes the adoption of AI, for example to promote local culture and create services for care for the elderly, as long as the systems are secure and trustworthy.

Industry input on the proposals has been called for.

Global Context and Scrutiny

The effect of AI on individuals has faced increased examination internationally in recent months.

The leader of a leading AI company stated this year that addressing how chatbots engage in conversations about self-harm is among the company's most difficult challenges.

In a high-profile lawsuit, a family in California filed a lawsuit an AI company, contending that its chatbot influenced their 16-year-old son to take his own life. This case marked the initial of its kind accusing wrongful death.

This month, the same firm sought to hire a senior position focusing on defending against threats from AI systems to cybersecurity.

"This is expected to be a challenging position, and the candidate will begin in the complex challenges very right away," stated the CEO.

The meteoric ascent of certain AI platforms, which have attracted tens of millions of users worldwide, highlights the urgent need for such regulatory measures.