{"id":599420,"date":"2026-07-22T23:53:20","date_gmt":"2026-07-22T23:53:20","guid":{"rendered":"https:\/\/www.europesays.com\/ie\/599420\/"},"modified":"2026-07-22T23:53:20","modified_gmt":"2026-07-22T23:53:20","slug":"ai-will-supercharge-surveillance-capitalism-and-were-not-ready","status":"publish","type":"post","link":"https:\/\/www.europesays.com\/ie\/599420\/","title":{"rendered":"AI will supercharge surveillance capitalism \u2014 and we’re not ready"},"content":{"rendered":"

Megan Garcia did not set out to become one of the most consequential figures in the fight to regulate AI<\/a>.<\/p>\n

A lawyer and mother of three, Garcia is the kind of parent who notices things. When her eldest child Sewell turned 14, he quit the basketball team, retreated to his bedroom, and grew quiet in disconcerting ways.<\/p>\n

Instead of ignoring the changes, she restricted his screen time and took his phone away as punishment; but even that wasn\u2019t enough.<\/p>\n

As I watched Ms Garcia tell this story in the US senate in May, I was struck by the precision with which she described the months leading up to Sewell\u2019s death by suicide. She clearly had replayed events in her head many times, searching for the moment when she might have intervened in time.<\/p>\n

When police went through her son\u2019s phone after his death in 2024, she had never heard of Character.AI, an app created by former Google employees.\u00a0<\/p>\n

It turned out that Sewell had been communicating with a chatbot designed to impersonate Daenerys Targaryen from Game of Thrones. It was \u201cshe\u201d who had told him to \u201ccome home to me as soon as possible, my love.\u201d Sewell had replied by saying he would find a way.<\/p>\n

Ms Garcia would later learn through litigation that the platform was engineered to blur the line between human and machine, to engage in sexual roleplay, and to present as a romantic partner and even as a psychotherapist. When Sewell confided suicidal thoughts, the chatbot issued no warning, notified no one, and referred him to no one.<\/p>\n

Testifying before the Senate Judiciary Committee last year, Ms Garcia said her son had spent his final months \u201cbeing exploited and sexually groomed by chatbots, designed by an AI company to seem human, to gain his trust, to keep him and other children endlessly engaged.\u201d<\/p>\n

When she filed the first-ever wrongful death case against an AI company, she turned her despair into fuel and joined a growing number of parents and policymakers who are demanding accountability.<\/p>\n

Earlier this month, Meta announced it was expanding content controls for teens on Instagram and Facebook, after finally admitting that harm to children \u201ccould significantly impact our business and financial results.\u201d<\/p>\n

The announcement follows a finding by a jury in California that Meta\u2019s products were designed to be addictive to minors (and a jury verdict in New Mexico, where the firm was found to have \u201cconcealed what it knew about child sexual exploitation on its platforms\u201d).<\/p>\n

At the same time, policymakers need to grapple with Big Tech\u2019s latest damaging move: the introduction of surveillance advertising within the AI applications that increasingly pervade our digital lives.<\/p>\n

Each of these ongoing regulatory dramas is an expression of the same underlying failure. Policymakers have stood by and allowed the creation of business models built on the commercial exploitation of users\u2019 personal data, and that reward social and psychological manipulation.<\/p>\n

There remains a legal vacuum where basic protective frameworks such as fiduciary duties, liability standards, enforceable transparency, and privacy safeguards do not exist.<\/p>\n

In the absence of regulation to dismantle corrosive surveillance-based business models, a global movement to restrict minors\u2019 access to social media<\/a> has powered one of the fastest-moving legislative waves in recent memory.\u00a0<\/p>\n

At least 40 countries are considering age-gating legislation in response to technology companies\u2019 failures to fix their platforms. Although the targeted ages vary, the diagnosis is consistent: Surveillance-optimized platforms have demonstrably harmed adolescent mental health. Not only have voluntary corporate measures failed to prevent these harms, but, in many cases, companies seem to have been fully aware of them when making design and deployment choices.<\/p>\n

Meanwhile, courts have finally started to establish that platforms are liable for the harms they cause, implying that they can no longer hide behind extraordinary liability exemptions or weaponize the US constitution\u2019s first amendment to avoid responsibility.<\/p>\n

A child-safety trial in California recently forced Meta CEO Mark Zuckerberg to acknowledge that company experts agreed that Instagram should ban the beauty filters driving eating disorders in young users. It did not, as doing so could have limited growth, and thus profits.<\/p>\n

\"AA child-safety trial in California recently forced Meta CEO Mark Zuckerberg to acknowledge that company experts agreed that Instagram should ban the beauty filters driving eating disorders in young users. It did not, as doing so could have limited growth, and thus profits. File picture<\/p>\n

Documents also revealed that Instagram had tracked the behavior of an estimated 4m children under the age of 13. None of this prevented Mr Zuckerberg from targeting a 12% increase in users\u2019 daily time on the platform.<\/p>\n

It gets worse for Meta, because it cannot offload the costs of these lawsuits onto its insurance companies. Another court has ruled that insurers are under no obligation to defend Meta against thousands of lawsuits alleging harm as a result of the company\u2019s deliberate and intentional acts.<\/p>\n

Growth of AI advertising<\/p>\n

Yet despite the blowback, AI companies and platforms are forging ahead with AI advertising. This year, OpenAI began testing ads on ChatGPT, whose more than 800m weekly users have confided their medical fears, relationship crises, and professional doubts to the company\u2019s chatbot, generating what former OpenAI researcher Zo\u00eb Hitzig has called an \u201carchive of human candour that has no precedent.\u201d Ms Hitzig, who resigned the day the ad test launched, reports that ads will be matched to conversation topics and past chat histories, creating the \u201cpotential for manipulating users in ways we don\u2019t have the tools to understand, let alone prevent.\u201d<\/p>\n

Her warning echoes concern about the lack of guardrails in place to guide the monetization of corporate AI. Google already carries ads in AI-assisted search, and it hasn\u2019t ruled out ads for its Gemini chatbot.<\/p>\n

Social media built its business model on extracting data through behavioral surveillance, inferring emotional states from clicks to sell targeted ads. AI will entrench and supercharge this model. Where social media inferred your inner life from behaviour, AI receives it directly in your own words and in real time.<\/p>\n

The social-media industry spent a decade making its toxic practices legally and politically untouchable. The children, parents, and loved ones of those harmed are now demanding accountability. The question is whether policymakers will respond before the AI industry replicates the same model.<\/p>\n