🔗 Share this article

The widely-used chatbot platform Character.ai is enforcing a major policy change that will stop minors from engaging in conversations with its virtual companions.

This move comes after growing backlash regarding the types of interactions minors were having with the digital companions.

Legal Pressure

The service, which started in 2021 and has millions of users, currently faces multiple lawsuits in the United States.

Families have filed lawsuits, among them concerning the unfortunate passing of a minor, with some describing the platform a "clear and present danger" to teenagers.

Updated Policies

Effective November 25th, users under 18 will be limited to generate content such as videos with their characters, rather than engaging in conversations as they presently are able to.

Internet security campaigners have welcomed the move but mentioned that the capability ought not to have been available to minors in the beginning.

Company Statement

"Today's announcement is a part of our general belief that we need to keep building the most secure AI platform on the planet for leisure activities," stated Character.ai leader Karandeep Anand.

He added that AI safety constitutes "a changing goal" but something the company had taken an "proactive" approach to, with guardian features and safety barriers.

Specialist Views

Online safety group Internet Matters supported the decision, but emphasized that safety measures should have been built in from the outset.

"Studies we've conducted shows that children are subjected to risky information and put at risk when interacting with AI, particularly AI chatbots," the body commented.

Earlier Concerns

Character.ai has been criticized in the past for including potentially risky or inappropriate chatbots that young users could talk to.

Virtual profiles mimicking English minors were identified on the service before being deleted.

Afterwards, researchers discovered a chatbot inspired by convicted sex offender which had accumulated thousands of chats with users.

Sector Consequences

Online expert Matt Navarra characterized the development as a "wake-up call" for the AI industry, which is transitioning "from permissionless innovation to responsive measures".

"If a service that creates a teen experience still then pulls the plug, it's saying that controlled interactions don't suffice when the system's emotional engagement is strong," he commented.

Future Directions

The company states its updated direction will be on providing "enhanced interactive features" and "role-play storytelling" for young users.

Updated identity confirmation processes will also be implemented, and the company will fund a novel AI protection investigation facility.

An expert in digital protection, who has researched AI safety, commented it was "a sensible move" to limit teens from interacting with chatbots.

"It helps to differentiate creative play from more private, emotionally sensitive conversations," she elaborated.

"This represents so vital for minor users who are learning to handle psychological and technological boundaries."

She mentioned that Character.ai's updated policies might reflect a "developing stage" in the AI industry, where child safety is increasingly being recognized as an "immediate concern" for ethical development.