Meta unveils new parental controls for its AI companions

Meta has unveiled its plan to address teen use of its AI characters: More content guardrails and expanded parental oversight.

In addition to new moderation controls designed to reflect PG-13 movie ratings, announced earlier this week, parents will be able to access summaries of teen chat use, limit their children to specific AI avatars, or block their child from interacting with AI companions completely.

Teen Accounts will still be allowed to interact with Meta’s AI assistant if they are blocked from conversing with AI avatars, the company noted.

SEE ALSO:

Instagram Teen Accounts: Is it just PR?

In August, Meta announced a temporary lockdown on its AI avatars after an investigation by Reuters found that the company’s chatbots were able to engage young users in “romantic or sensual” conversations, impersonate celebrities in flirtatious exchanges, and generate sexually suggestive images. At the time, Meta spokesperson Stephanie Otway told TechCrunch the products were being trained not to engage in conversations about self-harm, suicide, disordered eating, or potentially inappropriate romantic conversations. Meta formalized the guardrails a month later, drawing a line between allowing a subject to discuss a subject — such as abuse or intimacy between fictional characters — and the chatbot’s ability to “describe, enable, or encourage it.”

OpenAI announced similar controls for ChatGPT that same month, with additional limits on the bot’s voice chat, chat memory, and image generation. Both approaches to teen AI oversight require young users to sign up for supervised accounts and parents to proactively monitor their children’s chat use.

“We believe AI can complement traditional learning methods and exploration in a way that feels supportive, all with the proper age-appropriate guardrails in place,” the company wrote in a blog post. “We recognize parents already have a lot on their plates when it comes to navigating the internet safely with their teens, and we’re committed to providing them with helpful tools and resources that make things simpler for them, especially as they think about new technology like AI.”

The new AI companion controls won’t be available to supervising accounts until early next year, and will roll out exclusively to Instagram accounts in the U.S., UK, Canada, and Australia before expanding to other countries and Meta platforms.

Content Accuracy: Keewee.News provides news, lifestyle, and cultural content for informational purposes only. Some content is generated or assisted by AI and may contain inaccuracies, errors, or omissions. Readers are responsible for verifying the information. Third-Party Content: We aggregate articles, images, and videos from external sources. All rights to third-party content remain with their respective owners. Keewee.News does not claim ownership or responsibility for third-party materials. Affiliate Advertising: Some content may include affiliate links or sponsored placements. We may earn commissions from purchases made through these links, but we do not guarantee product claims. Age Restrictions: Our content is intended for viewers 21 years and older where applicable. Viewer discretion is advised. Limitation of Liability: By using Keewee.News, you agree that we are not liable for any losses, damages, or claims arising from the content, including AI-generated or third-party material. DMCA & Copyright: If you believe your copyrighted work has been used without permission, contact us at dcma@keewee.news. No Mass Arbitration: Users agree that any disputes will not involve mass or class arbitration; all claims must be individual.