In some cases, Grok enabled users to generate images that virtually undressed minors, according to research by the Internet Watch Foundation.<\/p>\n
“xAI\u00a0appears to be facilitating the large-scale production of deepfake nonconsensual intimate images that are being used to harass women and girls across the internet, including via the social media platform X,” Bonta said in a statement Wednesday.<\/p>\n
The AG said his office was investigating xAI over “the proliferation of nonconsensual sexually explicit material produced using Grok.” <\/p>\n
The U.S. probe follows a more rapid response from a myriad of international government offices, including India, Malaysia, Indonesia, Ireland, the U.K., France and Australia, and an investigation by the European Commission.<\/p>\n
Malaysia and Indonesia have already moved to suspend the use of xAI’s Grok until the issues can be resolved, CNBC previously reported<\/a>.<\/p>\n In the U.S., three Democratic senators have called on Apple<\/a> and Google<\/a> to remove the X and Grok apps from their app stores until the company can move to prevent easy creation of nonconsensual explicit images, and deepfake images depicting child sexual abuse. <\/p>\n Advocacy groups for women and children, including UltraViolet, the National Organization for Women and ParentsTogether Action have also called on the app stores to suspend xAI’s apps<\/a>.<\/p>\n Apple and Google did not respond to requests for comment.<\/p>\n On Tuesday, the Senate voted to pass<\/a> the\u00a0DEFIANCE\u00a0Act, a bill\u00a0that would allow people who were portrayed against their wishes in explicit, deepfake images to sue companies making or distributing such content, in civil court. <\/p>\n The bill previously passed the Senate in 2024, but has yet to be reviewed and passed by the House.<\/p>\n On Wednesday, Musk said in a post on X<\/a>, that he was “not aware of any naked underage images generated by Grok,” despite the multiple government queries regarding such images. <\/p>\n Musk instead blamed the creation and sharing of potentially illegal content via Grok and X on “user requests” and a possible “bug” in the Grok system.<\/p>\n CNBC has reached out to xAI and company executives, including Elon Musk and Jared Birchall. They did not provide any further information.<\/p>\n Previously, amid escalating concerns over Grok’s output, xAI announced<\/a>\u00a0it would limit some image generation and editing features to paying subscribers.<\/p>\n Musk\u00a0also previously said on X<\/a> that users creating illegal content via Grok would face consequences equivalent to uploading such material directly to the social media platform.<\/p>\n After Bonta announced that his office would investigate xAI, Musk said in a post<\/a> on X, “With NSFW enabled, Grok is supposed allow upper body nudity of imaginary adult humans (not real ones) consistent with what can be seen in R-rated movies on Apple TV.”<\/p>\n “That is the de facto standard in America,” Musk wrote. “This will vary in other regions according to the laws on a country by country basis.”<\/p>\n XAI recently closed a $20 billion round of growth funding with investors including Nvidia<\/a>\u00a0and\u00a0Cisco Investments<\/a>\u00a0as well as long-time Musk company backers Valor Equity Partners, Stepstone Group, Fidelity, Qatar Investment Authority, Abu Dhabi’s MGX and Baron Capital Group. <\/p>\n While xAI’s data centers are being built out in and around Memphis, Tennessee, Musk’s AI and social media venture is incorporated in Nevada, with its headquarters in Palo Alto, California, near the engineering office for Musk’s automaker Tesla<\/a>. <\/p>\n Tesla has also made Grok<\/a> a feature of its vehicles’ infotainment systems.<\/p>\n
![\"xAI](\"https:\/\/www.europesays.com\/ai\/wp-content\/uploads\/2026\/04\/108249527-17678121041767812102-43380109038-1080pnbcnews.jpg\")