Meta to notify parents of teen discussions about suicide with AI
Meta will now alert parents if their teen discusses suicide or self-harm with its AI chatbot. The change is a response to growing concerns about AI's impact on young users in crisis.
Meta announced on Thursday that it will begin notifying parents if their teenager engages in discussions about suicide or self-harm with the company's Meta AI chatbot. The company is also developing a feature to contact emergency services if a conversation suggests a risk of self-harm.
These updates come amid increasing scrutiny from regulators and parents regarding how AI chatbots respond to users in crisis, particularly teenagers. This liability question is increasingly shaping how AI companies design and market their products.
Meta stated that it has developed a dedicated AI system to identify conversations where a teen clearly indicates an intent to harm themselves. All chats flagged by the AI will undergo manual review before an alert is sent to parents.
The company acknowledged that the alerts may be distressing for parents. Meta indicated that in ambiguous situations, they will err on the side of caution and notify the parent, even if it means occasional alerts without concrete cause for concern.
The notification feature is now live for parents using Instagram's Parental Supervision tools in the U.S., U.K., Australia, and Canada. Meta plans to roll out the feature globally by the end of the year.