Meta said it will introduce more guardrails to its artificial intelligence (AI) chatbots – including blocking them from talking to teens about suicide, self-harm and eating disorders.<\/p>\n
It comes two weeks after a US senator launched an investigation into the tech giant after notes in a leaked internal document suggested its AI products could have “sensual” chats with teenagers<\/a>.<\/p>\n The company described the notes in the document, obtained by Reuters, as erroneous and inconsistent with its policies which prohibit any content sexualising children.<\/p>\n But it now says it will make its chatbots direct teens to expert resources rather than engage with them on sensitive topics such as suicide.<\/p>\n “We built protections for teens into our AI products from the start, including designing them to respond safely to prompts about self-harm, suicide, and disordered eating,” a Meta spokesperson said.<\/p>\n The firm told tech news publication TechCrunch<\/a> on Friday it would add more guardrails to its systems “as an extra precaution” and temporarily limit chatbots teens could interact with.<\/p>\n But Andy Burrows, head of the Molly Rose Foundation, said it was “astounding” Meta had made chatbots available that could potentially place young people at risk of harm.<\/p>\n “While further safety measures are welcome, robust safety testing should take place before products are put on the market – not retrospectively when harm has taken place,” he said.<\/p>\n “Meta must act quickly and decisively to implement stronger safety measures for AI chatbots and Ofcom should stand ready to investigate if these updates fail to keep children safe.”<\/p>\n Meta said the updates to its AI systems are in progress. It already places users aged 13 to 18 into “teen accounts” on Facebook, Instagram and Messenger, with content and privacy settings which aim to give them a safer experience<\/a>.<\/p>\n It told the BBC in April these would also allow parents and guardians to see which AI chatbots their teen had spoken to in the last seven days.<\/p>\n The changes come amid concerns over the potential for AI chatbots to mislead young or vulnerable users<\/a>.<\/p>\n A California couple recently sued ChatGPT-maker OpenAI over the death of their teenage son, alleging its chatbot encouraged him to take his own life<\/a>.<\/p>\n The lawsuit came after the company announced changes to promote healthier ChatGPT use last month.<\/p>\n “AI can feel more responsive and personal than prior technologies, especially for vulnerable individuals experiencing mental or emotional distress,” the firm said in a blog post<\/a>.<\/p>\n