{"id":516705,"date":"2026-01-15T00:42:09","date_gmt":"2026-01-15T00:42:09","guid":{"rendered":"https:\/\/www.europesays.com\/us\/516705\/"},"modified":"2026-01-15T00:42:09","modified_gmt":"2026-01-15T00:42:09","slug":"child-porn-concerns-lead-california-to-investigate-elon-musks-ai-firm","status":"publish","type":"post","link":"https:\/\/www.europesays.com\/us\/516705\/","title":{"rendered":"Child porn concerns lead California to investigate Elon Musk’s AI firm"},"content":{"rendered":"\n

SACRAMENTO\u00a0\u2014\u00a0California announced an investigation Wednesday into Elon Musk\u2019s xAI<\/a>, with Gov. Gavin Newsom accusing the artificial intelligence company of becoming a \u201cbreeding ground for predators to spread nonconsensual sexually explicit AI deepfakes.\u201d<\/p>\n

Grok, the xAI chatbot, includes image-generation features that allow users to morph existing photos into new images. The newly created images are then posted publicly on X.<\/p>\n

Critics say there are not sufficient safeguards on what images can be generated, prompting an influx of sexually explicit or nonconsensual images based on real people, including altered depictions that appear to show individuals partially or fully undressed. Others have generated images that appear to show minors, prompting criticism that the tools are being used to create child pornography.<\/p>\n

The social media site has previously said, \u201cwe take action against illegal content on X, including Child Sexual Abuse Material (CSAM), by removing it, permanently suspending accounts, and working with local governments and law enforcement as necessary.\u201d <\/p>\n

Earlier this month, Grok started limiting the ability for nonpaying users to create sexualized images amid a global outcry from users and governments.<\/p>\n

Newsom called the images being created \u201cvile.\u201d Atty. Gen. Rob Bonta said his office will use \u201call tools at our disposal to keep Californians safe.\u201d<\/p>\n

\u201cThe avalanche of reports detailing the non-consensual, sexually explicit material that xAI has produced and posted online in recent weeks is shocking,\u201d Bonta said in a statement Wednesday. \u201cThis material, which depicts women and children in nude and sexually explicit situations, has been used to harass people across the internet.\u201d<\/p>\n

Newsom signed a pair of bills in 2024 that made it illegal to create, possess or distribute sexually charged images of minors even when they\u2019re created with computers, not cameras. The measures took effect last year. <\/p>\n

Assembly Bill 1831<\/a>, authored by Assemblymember Marc Berman (D-Menlo Park), expanded the state\u2019s child porn prohibition to material that \u201ccontains a digitally altered or artificial-intelligence-generated depiction [of] what appears to be a person under 18 years of age\u201d engaging in or simulating sexual conduct.<\/p>\n

Senate Bill 1381<\/a>, authored by Sen. Aisha Wahab (D-Hayward), amended state law to more clearly prohibit using AI to create images of real children engaged in sexual conduct, or using children as models for digitally altered or AI-generated child pornography.<\/p>\n

Last year, Newsom signed two more bills into law that make it clear that people and companies \u2014 not AI tools \u2014 are legally responsible for harm, strengthening victims\u2019 ability to sue over nonconsensual deepfake pornography and preventing AI developers or users from claiming the technology acted on its own.<\/p>\n

While announcing the state investigation Wednesday, Bonta also urged xAI to take immediate action to ensure it is following California law. His office said potential victims can file a complaint at oag.ca.gov\/report.<\/p>\n

\u201cWe have zero tolerance for the AI-based creation and dissemination of nonconsensual intimate images or of child sexual abuse material,\u201d Bonta said.<\/p>\n

One researcher whose analysis was published by Bloomberg<\/a> found that X has become the most prolific platform for digitally undressing people. Genevieve Oh, a researcher who studies social media and deepfakes, found that during a 24-hour review, the @Grok account generated about 6,700 images per hour that were sexually suggestive or appeared to digitally undress people \u2014 compared with an average of 79 new images per hour across the five other leading deepfake sites.<\/p>\n

One prominent trend using Grok involves users asking the chatbot to create pictures of celebrities, politicians and private individuals in bikinis. The targets of those prompts are often women and girls.<\/p>\n

On Wednesday, 28 organizations that included women\u2019s groups, tech watchdogs and progressive activists published an open letter calling on both Google and Apple to remove X and Grok from their app stores because of the sexualized material. <\/p>\n

\u201cThe proliferation of non-consensual deepfakes has irreversibly altered the lives of women and children who\u2019ve been completely stripped of their privacy, autonomy, and safety,\u201d Jenna Sherman, campaign director at the gender justice organization UltraViolet, said in a statement. \u201cThis may be a game to Elon Musk \u2014 who instead of taking down Grok entirely until proper safeguards were implemented instead made AI image abuse a paid feature \u2014 but it\u2019s deadly serious for the thousands of users actively being harmed.\u201d<\/p>\n

The European Commission opened inquiries into Grok\u2019s algorithms and potential dissemination of illegal content, ordering Musk\u2019s company to preserve documents related to the chatbot\u2019s development.<\/p>\n

Sweden joined the criticism of how Grok is being used to target women after Deputy Prime Minister Ebba Busch became a target of users who generated a picture of her in a bikini. Busch said the picture was \u201cactually a pretty good picture.\u201d<\/p>\n

\u201cThe problem is I was involuntarily undressed by Elon Musk\u2019s Grok on X,\u201d Busch said in a video posted on X. \u201cLet me be very clear, as a woman I decide when, where and to whom I show myself in a bikini.\u201d<\/p>\n

In the video Busch uploaded, she\u2019s dressed in heavy winter gear, saying she was hunting in the snow. Several users responded to the video with newly generated Grok images and videos showing Busch in a bikini.<\/p>\n","protected":false},"excerpt":{"rendered":"SACRAMENTO\u00a0\u2014\u00a0California announced an investigation Wednesday into Elon Musk\u2019s xAI, with Gov. Gavin Newsom accusing the artificial intelligence company…\n","protected":false},"author":3,"featured_media":516706,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[5],"tags":[230516,276,128688,88422,199965,66,230519,46859,5022,230515,50,3435,230518,38317,15613,103,230517],"class_list":{"0":"post-516705","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-world","8":"tag-ai-site","9":"tag-california","10":"tag-child-porn","11":"tag-child-sexual-abuse-material","12":"tag-creation","13":"tag-elon-musk","14":"tag-explicit-material","15":"tag-illegal-content","16":"tag-investigation","17":"tag-new-image","18":"tag-news","19":"tag-newsom","20":"tag-nonconsensual-image","21":"tag-user","22":"tag-wednesday","23":"tag-world","24":"tag-xai-chatbot"},"share_on_mastodon":{"url":"https:\/\/pubeurope.com\/@us\/115896342523030303","error":""},"_links":{"self":[{"href":"https:\/\/www.europesays.com\/us\/wp-json\/wp\/v2\/posts\/516705","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.europesays.com\/us\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.europesays.com\/us\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/us\/wp-json\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/us\/wp-json\/wp\/v2\/comments?post=516705"}],"version-history":[{"count":0,"href":"https:\/\/www.europesays.com\/us\/wp-json\/wp\/v2\/posts\/516705\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/us\/wp-json\/wp\/v2\/media\/516706"}],"wp:attachment":[{"href":"https:\/\/www.europesays.com\/us\/wp-json\/wp\/v2\/media?parent=516705"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.europesays.com\/us\/wp-json\/wp\/v2\/categories?post=516705"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.europesays.com\/us\/wp-json\/wp\/v2\/tags?post=516705"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}