Meta has introduced new features to notify parents when their teenagers discuss suicide or self-harm with Meta AI, the company’s chatbot. Parents utilizing the supervision tool on Instagram will receive alerts if their teenage children exhibit crisis signs while interacting with Meta AI across Meta’s platforms. This initiative expands Meta’s existing safety measures, where the chatbot previously directed teens mentioning self-harm or suicide to crisis helplines. Additionally, repeated searches related to self-harm and suicide on Instagram prompt notifications to parents.
The enhanced tools are currently available to users in Canada, the U.K., the U.S., and Australia. Meta mentioned its intention to incorporate a flagging system for Meta AI back in February. The company is also developing a feature to contact emergency services if conversations with the chatbot, by both teens and adults, indicate potential self-harm intentions.
While acknowledging the value of these tools, experts and advocates believe more efforts are necessary. Technology analyst Carmi Levy stated that while the tools are beneficial, they are not flawless and may generate false positives. Meta plans to err on the side of caution by alerting parents even in uncertain situations.
Hanna Grover, a youth advocate, expressed concerns that determined teens might find ways to circumvent these features. Sara Austin, CEO of Children First Canada, emphasized the need for stricter regulations to protect young individuals. The Canadian government recently introduced the Safe Social Media Act, requiring AI chatbot developers to implement safety protocols for users indicating self-harm tendencies.
The introduction of Meta’s new tool coincides with growing scrutiny over AI’s role in mental health crises. OpenAI faced criticism for not alerting authorities about concerning content on an account linked to a tragic incident. The company is being sued for alleged involvement in a teenager’s suicide. OpenAI has responded by adding parental controls and alert features akin to Meta’s system.
The ongoing advancements in AI monitoring tools highlight the importance of safeguarding young individuals’ mental well-being online. Parents are advised to utilize these tools cautiously as a supplementary means of overseeing their children’s online activities.
If you or someone you know is struggling, there are resources available for support:
– Canada’s Suicide Crisis Helpline: Call or text 988.
– Kids Help Phone: 1-800-668-6868. Text 686868. Live chat counseling on the website.
– Canadian Association for Suicide Prevention: Find a 24-hour crisis center.
– The Centre for Addiction and Mental Health provides guidance on addressing suicide concerns with a loved one.
