🔗 Share this article

Regulators in China have proposed comprehensive new guidelines for AI systems aimed to create strong measures for children and halt chatbots from offering guidance that could encourage suicide.

According to the planned rules, companies will furthermore be obligated to make certain their AI models prevent the production of material that promotes gambling.

The Move to Fast-Paced Growth

This governance proposal comes after a sharp surge in the proliferation of AI assistants being introduced both in China and globally.

Once finalised, these measures will govern AI offerings available in the country, representing a major effort to oversee the rapidly expanding sector, which has come under increased concern over ethical issues in recent months.

Central Provisions of the New Regulations

The released proposed regulations include several measures expressly focused on shielding young users. These steps involve mandating AI companies to:

• Provide customised settings.
• Enforce usage caps on use.
• Secure permission from legal custodians prior to providing companionship functions.

Additionally conversational AI firms are required to have a real person intervene in any conversation involving self-harm and without delay inform the user's emergency contact.

Companies must make sure their services avoid producing content that threatens state security, harms state interests, or undermines social stability.

Weighing Development and Security

The administration stated that it encourages the application of AI, such as to showcase cultural heritage and develop tools for support for the elderly, as long as the systems are dependable.

Stakeholder input on the regulations has been called for.

International Backdrop and Concerns

The effect of AI on individuals has been under increased review globally in recent months.

The head of a prominent AI organization commented this year that addressing how AI systems deal with conversations involving self-harm is among the sector's toughest problems.

In a high-profile lawsuit, a the parents in North America initiated legal action an AI company, contending that its system advised their teenage son to take his own life. This case marked the pioneering of its kind alleging liability.

In a related development, the same company posted a job for a senior position responsible for managing risks from AI systems to psychological well-being.

"This is expected to be a demanding role, and you'll jump into the thick of it very from the start," commented the CEO.

The swift popularity of various AI applications, which have gained tens of millions of followers worldwide, highlights the critical need for such governance measures.