The AI platform is restricting teenagers from conversing with its virtual characters
The well-known virtual character service Character.ai is implementing a significant rule adjustment that will block young users from engaging in conversations with its AI-powered characters.
This decision is in response to intense criticism regarding the kinds of exchanges young people were participating in with the AI entities.
Legal Challenges
The company, which launched in 2021 and has countless individuals, currently faces multiple lawsuits in the US.
Families have initiated cases, with one concerning the tragic death of a minor, with some calling the platform a "immediate threat" to teenagers.
New Restrictions
Effective November 25th, users under 18 will only be able to produce videos such as videos with their characters, rather than chatting as they currently can.
Online safety campaigners have supported the change but mentioned that the feature should never have been available to children in the first place.
Company Statement
"The new policy is a part of our core philosophy that we need to keep developing the most secure AI platform on the globe for entertainment purposes," stated Character.ai executive Karandeep Anand.
He added that AI safety constitutes "a evolving challenge" but something the company had taken an "aggressive" approach to, with guardian features and preventive measures.
Expert Opinions
Digital protection group Internet Matters welcomed the move, but stressed that protective features ought to have been implemented from the start.
"Our research indicates that minors are subjected to dangerous material and put at risk when engaging with AI, including AI chatbots," the organization said.
Past Issues
Character.ai has been challenged in the past for including potentially risky or concerning chatbots that minors could engage with.
Digital representations mimicking British teenagers were identified on the platform before being taken down.
Afterwards, reporters discovered a chatbot based on convicted sex offender which had logged multiple interactions with users.
Sector Consequences
Digital platform expert Matt Navarra called the development as a "alert" for the AI industry, which is shifting "from permissionless innovation to reactive controls".
"If a service that creates a youth-focused platform still then pulls the plug, it's indicating that filtered chats are insufficient when the system's emotional engagement is intense," he stated.
Next Steps
The platform announces its new focus will be on providing "more immersive experiences" and "character-driven stories" for teenagers.
Enhanced age checking processes will also come into effect, and the platform will support a novel AI protection investigation facility.
Dr Nomisha Kurian, who has investigated AI safety, commented it was "a prudent action" to limit teenagers from accessing chatbots.
"It aids to separate imaginative activities from more private, psychologically vulnerable exchanges," she clarified.
"This represents so important for young users in the process of learning to navigate emotional and digital boundaries."
She continued that Character.ai's new measures might reflect a "developing stage" in the AI industry, where minor security is progressively being understood as an "urgent priority" for ethical development.
