Meta's big move! If a child talks about suicide to an AI chatbot, parents will be alerted
There have been numerous cases where young children have asked AI about suicide or self-harm, leading some AI chatbot companies to face scrutiny. Perhaps this is why Meta has now introduced a new safety feature that will immediately alert parents if children ask AI about suicide-related questions.
Rj Kesari News Desk: Meta's new safety feature will immediately alert parents if your child, while talking to an AI chatbot, asks the AI about suicide or self-harm. This chatbot is available on Instagram and other Meta platforms.
This move could change the way parents monitor their teens' interactions with artificial intelligence. This change may be due to AI companies facing increased scrutiny over how their chatbots respond to users experiencing mental health crises, especially young children.
This new feature is initially rolling out to parents using Instagram's parental supervision tools in the United States, United Kingdom, Canada, and Australia. Meta says it plans to expand the feature globally later this year.
Meta's AI will review chats before alerting
According to Meta, a dedicated AI system has been developed to detect conversations in which a teenager explicitly mentions self-harm or suicide.
However, the company says the AI won't make the final decision. Each flagged conversation will first be manually reviewed before a notification is sent to parents.
"We understand how upsetting it can be for parents to receive these alerts," Meta said in a blog post. Therefore, as we continue to improve our detection, we will manually review all chats flagged by AI before sending an alert.
The latest update builds on the safety features Meta has introduced over the past few months. Parents can also see the topics their child has discussed with Meta AI over the past week.