Meta has launched a new feature that will warn parents if young people talk about suicide or self-harm in artificial intelligence chats on Instagram, Facebook or Meta Horizons. Parents who want to benefit from this system must activate the family control tools offered by Meta and select the accounts they want to control.

The new feature is being implemented to support the platform’s existing security measures. When Meta detects signs that teens may be self-harming, she continues to direct them to crisis boundaries and encourage them to seek help from adults.

New safety measures for parents

Meta states that artificial intelligence aims to detect even subtle references in chats, but each flagged content will be reviewed manually. The company is cautious about the risk of false reporting, recognizing that it may be distressing for parents to receive these notifications.

The company, which prefers to inform parents even in uncertain situations, sees this system as a starting point. In order for parents to control their children’s accounts, they must first configure family control settings.

This new feature is currently available in the USA, Canada, UK and Australia. Meta plans to expand its practice of notifying emergency services when it detects suicide risks in Facebook and Instagram posts to Meta AI chats in the future.

Emergency response capacity is expanding

The company is working to contact emergency services in cases where a person risks harming himself during conversations with Meta AI. Last year, Meta made more than 19 thousand referrals worldwide, helping first responders reach people at risk.

Meta emphasizes that young people and adults should seek professional support in such situations. Individuals can request help by contacting resources such as 988 Suicide and Crisis Line or by calling emergency services. What do you think about this new step by Meta to increase the safety of young people?