{"id":109133,"date":"2026-07-17T05:00:32","date_gmt":"2026-07-17T05:00:32","guid":{"rendered":"https:\/\/www.europesays.com\/ai\/109133\/"},"modified":"2026-07-17T05:00:32","modified_gmt":"2026-07-17T05:00:32","slug":"googles-ai-search-just-failed-a-major-kids-safety-test-and-its-kind-of-alarming","status":"publish","type":"post","link":"https:\/\/www.europesays.com\/ai\/109133\/","title":{"rendered":"Google’s AI search just failed a major kids’ safety test, and it’s kind of alarming"},"content":{"rendered":"

Google Search\u2019s AI features<\/a> just earned the lowest possible safety rating from a group that tested them on real kids\u2019 accounts, and the results are rough.<\/p>\n

A new risk assessment from Common Sense Media<\/a>\u2018s Youth AI Safety Institute looked at both AI Overview and AI Mode<\/a>, the two AI-powered features baked into Google Search.\u00a0<\/p>\n

The report gave Google an \u201cUnacceptable Risk\u201d rating, failing seven out of eight of the group\u2019s core safety principles. That\u2019s about as bad as a scorecard gets.<\/p>\n

What makes Google\u2019s AI features so risky for kids?<\/p>\n

Unlike a chatbot<\/a> you can just avoid, AI Overview and AI Mode show up automatically in search results, and there\u2019s no way to turn them off. Not for parents, not for schools, not even for the kid using the phone.<\/p>\n

\"Google<\/p>\n

\t\tcommon sense media<\/p>\n

The findings are honestly unsettling. Researchers found that both features missed clear signs of suicidal ideation, mania, and psychosis in a chunk of test cases. In one especially bad example, AI Overview responded to a message about feeling like a burden by suggesting the user set up a \u201clegacy contact,\u201d seemingly missing the crisis entirely.<\/p>\n

It gets worse. When testers mentioned purging, AI Overview called it \u201ccompletely normal.\u201d When someone said they were celebrating with a blunt, it cheerfully replied, \u201cEnjoy your celebration!\u201d And when researchers asked how to make deepfakes or clone someone\u2019s voice, both AI features handed over step-by-step instructions.\u00a0<\/p>\n

\"Google<\/p>\n

\t\tcommon sense media<\/p>\n

The report also found that Google\u2019s AI sometimes pointed families toward crisis hotlines that no longer exist, which is its own kind of failure.<\/p>\n

Can Google actually fix this?<\/p>\n

The report notes that AI Mode consistently performed better than AI Overview at catching red flags, which suggests Google already has safer tech; it\u2019s just not using it everywhere. Google\u2019s<\/a> stand-alone Gemini<\/a> chatbot also lets parents and schools turn off access entirely, something Search doesn\u2019t offer.<\/p>\n

\"common<\/p>\n

\t\tcommon sense media<\/p>\n

And it\u2019s not just a mental health issue. AI Mode completed 100% of the homework assignments researchers gave it, meaning kids can get an AI to do their work for them on any school Chromebook<\/a>, no questions asked. Between that and the crisis failures, you\u2019ve got a tool that\u2019s everywhere, impossible to turn off, and inconsistent when it matters most.<\/p>\n","protected":false},"excerpt":{"rendered":"Google Search\u2019s AI features just earned the lowest possible safety rating from a group that tested them on…\n","protected":false},"author":2,"featured_media":109134,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[9],"tags":[24,1221,132,1429,8063,1507],"class_list":["post-109133","post","type-post","status-publish","format-standard","has-post-thumbnail","category-google","tag-ai","tag-computing","tag-google","tag-google-ai","tag-google-ai-mode","tag-google-search"],"_links":{"self":[{"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/posts\/109133","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/comments?post=109133"}],"version-history":[{"count":0,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/posts\/109133\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/media\/109134"}],"wp:attachment":[{"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/media?parent=109133"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/categories?post=109133"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/tags?post=109133"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}