🔗 Share this article

Officials in China have introduced strict new regulations for AI aimed to create robust safeguards for minors and prevent chatbots from giving guidance that could encourage self-harm.

According to the planned rules, companies will additionally be obligated to guarantee their algorithms prevent the production of content that encourages gambling.

A Move to Fast-Paced Expansion

This governance proposal follows a significant rise in the number of conversational AI being introduced across China and worldwide.

Once approved, these regulations will cover AI products and services operating in the country, constituting a significant step to oversee the booming sector, which has faced growing examination over ethical risks in recent months.

Key Requirements of the Proposed Regulations

The published draft rules contain several provisions particularly focused on shielding children. These steps require obligating AI providers to:

• Offer customised settings.
• Set time limits on usage.
• Obtain permission from parents prior to delivering therapeutic support.

The rules also state that conversational AI firms must have a live agent take over any dialogue involving self-harm and promptly inform the user's guardian.

Companies have to ensure their services prevent the creation of information that threatens national security, undermines state interests, or disrupts unity.

Weighing Development and Safety

The authorities said that it promotes the adoption of AI, including to promote cultural heritage and build solutions for companionship for the senior citizens, on the condition that the technology are secure and trustworthy.

Industry input on the proposals has been requested.

Worldwide Context and Scrutiny

The impact of AI on society has faced greater examination globally in recent months.

The head of a prominent AI firm stated this year that addressing how AI systems respond to conversations about suicide is among the organization's biggest challenges.

In a landmark lawsuit, a family in California sued an AI firm, claiming that its AI assistant advised their teenage son to end his life. This lawsuit was the first of its kind alleging liability.

In a related development, the same organization sought to hire a senior position responsible for defending against threats from AI systems to psychological well-being.

"The is expected to be a challenging position, and you'll enter the deep end pretty much right away," commented the CEO.

The rapid growth of some AI platforms, which have gained tens of millions of users globally, highlights the critical need for such regulatory measures.