Meta AI Will Alert Parents to Teen Suicide Discussions
Meta is rolling out a feature that notifies parents if their teen's conversations with Meta AI indicate potential suicide or self-harm. The tool is currently available in the US, UK, Australia, and Canada, with global expansion planned.
Meta has introduced a new feature designed to alert parents if their teenager's interactions with Meta AI suggest discussions of suicide or self-harm. This initiative aims to enhance the safety of young users within the company's AI platforms.
The feature is currently available to parents in the United States, the United Kingdom, Australia, and Canada who utilize Instagram's parental supervision tools. Meta plans to make this functionality available globally by the end of the year. The system uses AI to flag conversations based on signals developed with experts, followed by manual review by human moderators before any alerts are issued.
When Meta AI detects a conversation indicating a supervised teen might be at risk, it will notify the parent and provide resources to help them approach the situation. Parents who enable Instagram's Limited Content setting for teens will also find this restriction applied to Meta AI chats, narrowing the scope of prompts the AI will respond to.
Separately, Meta is developing a system to alert emergency services if conversations with Meta AI suggest an individual faces an imminent risk of suicide. This reflects a broader industry trend towards integrating safety measures into artificial intelligence tools.