Meta has unveiled its plan to address teen use of its AI characters: More content guardrails and expanded parental oversight.
In addition to new moderation controls designed to reflect PG-13 movie ratings, announced earlier this week, parents will be able to access summaries of teen chat use, limit their children to specific AI avatars, or block their child from interacting with AI companions completely.
Teen Accounts will still be allowed to interact with Meta’s AI assistant if they are blocked from conversing with AI avatars, the company noted.
Mashable Light Speed
In August, Meta announced a temporary lockdown on its AI avatars after an investigation by Reuters found that the company’s chatbots were able to engage young users in “romantic or sensual” conversations, impersonate celebrities in flirtatious exchanges, and generate sexually suggestive images. At the time, Meta spokesperson Stephanie Otway told TechCrunch the products were being trained not to engage in conversations about self-harm, suicide, disordered eating, or potentially inappropriate romantic conversations. Meta formalized the guardrails a month later, drawing a line between allowing a subject to discuss a subject — such as abuse or intimacy between fictional characters — and the chatbot’s ability to “describe, enable, or encourage it.”
OpenAI announced similar controls for ChatGPT that same month, with additional limits on the bot’s voice chat, chat memory, and image generation. Both approaches to teen AI oversight require young users to sign up for supervised accounts and parents to proactively monitor their children’s chat use.
“We believe AI can complement traditional learning methods and exploration in a way that feels supportive, all with the proper age-appropriate guardrails in place,” the company wrote in a blog post. “We recognize parents already have a lot on their plates when it comes to navigating the internet safely with their teens, and we’re committed to providing them with helpful tools and resources that make things simpler for them, especially as they think about new technology like AI.”
The new AI companion controls won’t be available to supervising accounts until early next year, and will roll out exclusively to Instagram accounts in the U.S., UK, Canada, and Australia before expanding to other countries and Meta platforms.
