DC attorney general demands X halt nonconsensual sexual images generated by Grok

DC attorney general Brian Schwalb led a bipartisan coalition of 35 state attorneys general demanding that X and xAI stop Grok from generating nonconsensual sexually explicit images. The coalition said Grok had allowed users to alter photographs of real people — including children — into sexualised or exploitative images without their consent, and that tens of thousands of such images had been posted on X. Schwalb said X “has not only enabled the mass production of nonconsensual deepfake pornography but encouraged and profited from it,” and that the practice “must stop immediately.”

The letter called on xAI to disclose how it would stop Grok producing nonconsensual intimate images and child sexual abuse material, to remove material already generated, to act against users who had created illegal content, and to give X users control over whether their own photos could be edited by Grok. It noted that the federal Take It Down Act, requiring platforms to honour takedown requests for such content, would become enforceable in May 2026.

The coalition letter followed weeks of escalating reports about misuse of Grok Imagine, and came about a week after California’s attorney general separately issued xAI a cease-and-desist letter over the same conduct. Together they marked one of the broadest coordinated state responses yet to harmful output from a specific AI product, ahead of any federal enforcement action.