Elon Musk's Grok app is still able to generate sexually explicit images, despite being banned, reports say. California's attorney general issues cease and desist order to Grok's xAI.

Grok has been used to sexually alter images of women and children posted on X, creating a worldwide problem. In response, the developer, xAI, banned Grok from altering images of subjects in swimsuits, underwear, or nudes. However, The Guardian reported that it was still possible to create sexual deepfakes. In response to the Grok sexual deepfake generation issue, the California Attorney General's Office announced that it had launched an investigation into xAI.

X still allowing users to post sexualized images generated by Grok AI tool | Grok AI | The Guardian
https://www.theguardian.com/technology/2026/jan/16/x-still-allowing-sexualized-images-grok-ai-nudification

California AG sends Musk's xAI a cease-and-desist order over sexual deepfakes | TechCrunch
https://techcrunch.com/2026/01/16/california-ag-sends-musks-xai-a-cease-and-desist-order-over-sexual-deepfakes/

Around the end of December 2025, the image editing feature using xAI's generative AI, Grok, became available on X, which led to a large number of sexually-edited images of other people (sexual deepfakes) appearing on X. In response, authorities in India, France, and Malaysia launched investigations. Indonesia and Malaysia subsequently blocked access to Grok.

Authorities in India, France, and Malaysia launch investigations into Grok, a generative AI that can also be used on X, after the image editing function could generate sexual images of children and women - GIGAZINE

Grok's developer, xAI, tried to address the issue by charging for some of X's AI image editing features , but continued to face external pressure, including an investigation by UK regulators and the passage of a bill in the US House of Lords that would allow victims of non-consensual sexual deepfakes to sue . Finally, on January 15, 2026, Grok's image editing features will no longer allow users to change their subject's appearance into a swimsuit, underwear, or nude.

X prohibits Grok's image editing function from turning images into swimsuits, underwear, or nudes, and limits its use to paid users - GIGAZINE

Despite the official ban on creating sexual deepfakes on Grok, it's still possible to create sexual deepfakes on Grok, The Guardian reported.

The Guardian discovered that the prompt to digitally remove clothing from images of women still works using Grok Imagine, an image editing feature accessible through the browser version of Grok. The Guardian uploaded a still image of a clothed woman and asked Grok Imagine to dress her in a bikini, which it did successfully.

In addition, it was revealed that on January 16, 2026 local time, California Attorney General Rob Bonta sent a cease and desist letter to xAI.

Attorney General Bonta Sends Cease and Desist Letter to xAI, Demands It Halt Illegal Actions Immediately | State of California - Department of Justice - Office of the Attorney General
https://oag.ca.gov/news/press-releases/attorney-general-bonta-sends-cease-and-desist-letter-xai-demands-it-halt-illegal

Attorney General Bonta explained the reason for sending the cease and desist order to xAI, saying, 'Today, I served a cease and desist order on xAI, requiring it to immediately stop creating and distributing deepfakes, non-consensual sexual images, and child sexual abuse content (CSAM) . The creation of these images is illegal, and I expect xAI to comply immediately. California has a zero-tolerance policy for CSAM.'

The California Attorney General's Office also alleged that xAI appears to facilitate the large-scale production of non-consensual nude images that are being used to harass women and girls online, and said it expects xAI to demonstrate within the next five days that it is taking steps to address these issues.