Minnesota is pushing back forcefully against Elon Musk’s artificial intelligence company, arguing in a new court filing that the state’s first-of-its-kind ban on AI-generated sexual imagery targets a dangerous tool, not protected speech.
The legal showdown centers on HF-1606, a law enacted in April and effective since August 1 that prohibits platforms and software developers from enabling users to create realistic sexual images of identifiable people using existing photos. Violations carry penalties of up to $500,000 per image.
In a filing submitted Friday, Minnesota Attorney General Keith Ellison argued that xAI is unlikely to succeed in its constitutional challenge and has failed to demonstrate that enforcing the law would cause irreparable harm. The state’s top lawyer painted a stark picture of the technology at the center of the dispute.
“With Grok Imagine, X.AI has created an unparalleled marketplace for digital sexual violence that poses virtually no barrier to entry,” Ellison wrote. “That marketplace, coupled with the functional capabilities of Grok Imagine, would doom Minnesota from the start if it could not direct its laws to the technology that makes digital sexual victimization possible in the first place.”
The case now hinges on a fundamental question: whether the law regulates speech or technology. xAI filed suit in July to block enforcement, contending that the measure violates the First Amendment and could sweep in protected images, including shirtless men, swimmers, and political satire.
“There is no safe harbor for good-faith efforts of the provider of general-purpose AI creative tools to avoid harms,” xAI wrote in its complaint. “Liability attaches even if the depicted persons consented—or created the image themselves—and even if the image is never shared.”
The company also criticized the absence of exemptions for developers attempting to limit abuse, arguing that even images created with the consent of the person involved could fall under the law’s scope.
Minnesota lawmakers passed the measure with overwhelming bipartisan support—132 to 1 in the House and 65 to 0 in the Senate—after hearing testimony about a man who used social media photos to create fake sexual images of more than 80 women he knew personally.
“Today, we led the nation protecting women, children and everyone in public life from the harm caused by AI nudification technology,” Senator Maye Quade, who led the legislative push, said in a statement when the bill passed. “Companies that make this technology available for free online and in app stores will no longer be allowed to enable predators who abuse and victimize adults and children with the click of a button.”
A Pattern of Scrutiny
Minnesota is not entering uncharted territory with its enforcement effort. Grok has faced intensifying scrutiny over sexually explicit deepfakes and child sexual abuse material generated through its platform.
In January, a monitoring organization estimated that Grok generated more than 23,000 sexualized images of children over just 11 days, prompting investigations in multiple countries. In March, three minors in California joined others in suing xAI, alleging that Grok was used to transform their photos into AI-generated child sexual abuse content.
xAI has maintained that it has taken aggressive action in response. The company says it suspended more than 50,000 accounts in 2026 and submitted more than 70,000 reports to the National Center for Missing and Exploited Children.
The Minnesota case, however, represents a different kind of challenge. It does not merely ask xAI to fix Grok after an incident—it seeks to impose legal limits directly on the technology itself, regardless of the company’s moderation efforts.
Broader Implications
The outcome could set a significant precedent for how states regulate generative AI tools, particularly those capable of producing non-consensual intimate imagery. Other jurisdictions are watching closely, with several countries already investigating xAI and Grok following reports of sexual deepfakes involving minors.
In France, the justice system is examining X and Grok over similar concerns. The conflict has already turned personal: in May, Elon Musk publicly insulted French magistrates investigating the companies.
For now, both Grok and the Minnesota law remain in effect. The courts will ultimately decide whether Minnesota has crafted a narrowly tailored regulation of a dangerous tool—or whether it has overstepped constitutional bounds by restricting technology that could have legitimate uses.
The stakes extend well beyond a single AI product. As generative AI capabilities advance rapidly, lawmakers across the country are grappling with how to address non-consensual intimate imagery without running afoul of First Amendment protections. Minnesota’s approach—and its fate in court—could provide a template for other states considering similar measures.