Meta has introduced new tools to notify parents when their teenagers discuss suicide or self-harm with the company’s chatbot, Meta AI. The supervision feature on Instagram allows parents to receive alerts if their teenage child displays signs of crisis while engaging with Meta AI on any Meta platform. Meta AI is accessible on Instagram, WhatsApp, Facebook Messenger, and the Meta.ai website.
Previously, when a teenager hinted at self-harm or suicide, the AI chatbot would guide them to crisis support services and advise them to reach out to a trusted individual. Additionally, if teen users on Instagram conducted multiple searches related to self-harm and suicide, parents would receive notifications. This initiative is an extension of Meta’s safety measures.
The new feature is currently operational in Canada, the U.K., the U.S., and Australia. Meta announced plans to implement a flagging system for Meta AI back in February. The company is also developing a tool to alert emergency services when conversations with the chatbot suggest potential self-harm or suicide, involving both adults and teens.
Despite the positive reception of the new tool, advocates emphasize the need for further enhancements. Technology analyst Carmi Levy from London acknowledges the positive impact of empowering teens and parents with improved online safety tools. However, Levy notes that no tool is flawless and may have limitations in identifying actual risks or generating false alerts.
Meta has chosen to err on the side of caution by notifying parents even in cases of ambiguous intent from teenagers. The company emphasizes ongoing monitoring to ensure the effectiveness of the tool. Parents are advised to view this tool as one of several resources to supervise their children’s online activities.
Youth advocate Hanna Grover warns that teenagers may attempt to circumvent the feature by providing false information. Sara Austin, CEO of Children First Canada, believes that voluntary measures are insufficient and advocates for stricter regulations to safeguard young individuals.
Legislation, such as the Safe Social Media Act introduced by the Canadian government in June, aims to enforce safety requirements for AI chatbots regarding self-harm, suicide, or harm to others. Meta’s new tool launch coincides with increased scrutiny of AI’s role in mental health crises among young individuals.
OpenAI’s recent actions, including banning an account related to a tragic incident and facing legal action in a separate case, highlight the importance of responsible AI usage. OpenAI has since implemented parental controls and alert features similar to Meta’s to enhance safety measures.
In conclusion, while these tools aim to enhance online safety for young users, continuous monitoring and regulatory efforts are essential to address the evolving challenges posed by digital platforms.
