Elon Musk’s xAI sued a user on Tuesday, alleging he used the Grok chatbot to create child sexual abuse materials. It’s one of the first lawsuits\u202ffiled by a tech company against users who allegedly create explicit content with AI.<\/p>\n
Musk’s company alleged in the lawsuit that a user named Terry Wayne Harwood violated its terms of service “to convert non-sexual photographs into sexually explicit images without the photograph subjects’ knowledge or consent.” Harwood, along with three other men, was\u202farrested<\/a>\u202fearlier this year in South Carolina on multiple counts of alleged sexual exploitation of a minor.<\/p>\n CNN has reached out to the attorney representing Harwood in his criminal case for comment.<\/p>\n The lawsuit, filed in the US District Court for the Northern District of Texas, alleges Harwood created multiple xAI accounts and entered “misleading prompts” to create explicit deepfakes of both minors and adults.<\/p>\n The lawsuit further alleges that Harwood designed prompts it characterized as “misleading” in order to “circumvent” what it described as “built-in safeguards” to prevent against the creation of explicit material depicting minors.<\/p>\n “Defendant breached the xAI Terms of Service and Acceptable Use Policy by leveraging Grok to generate non-consensual sexually explicit images and CSAM,” or child sexual abuse material, the suit adds.<\/p>\n Earlier this year, Grok came under fire for a tool that allowed\u202f“digital undressing,”<\/a>\u202fincluding AI-generated images of children. After users began noticing<\/a> a surge in non-consensual, sexualized deepfakes late last year, Musk and xAI said they would take action against such illegal use of the AI. “Anyone using Grok to make illegal content will suffer the same consequences as if they upload illegal content,” Musk write in a January 6 social media post quoted in the suit.<\/p>\n Harwood’s alleged misuse of Grok exposed xAI “to significant legal risk and reputational damage,” the lawsuit alleged.<\/p>\n In the lawsuit, xAI claims that it “has suspended 52,222 accounts and made 73,604 reports to (National Center for Missing & Exploited Children) in 2026, resulting in (at least) 244 arrests.”<\/p>\n The lawsuit seeks a declaration that Harwood broke the site’s Terms of Service and unspecified damages.<\/p>\n xAI has faced scrutiny over its chatbot before. Last year, \u200bthe company posted a lengthy apology for a series of violent and antisemitic posts from Grok,\u202fplacing the blame on a system update<\/a>.<\/p>\n CNN’s Hadas Gold contributed to this report.<\/p>\n