Authorities in India, France, and Malaysia have launched investigations into Grok, a generative AI that can also be used on X, after the image editing function could generate sexual images of children and women.



As a result of the image editing function of the generative AI 'Grok' becoming easily accessible on X since December 2025, cases of unauthorized editing of other people's images have occurred, as well as cases of unauthorized sexual manipulation of photos of cosplayers and children . In response, regulatory authorities in France and Malaysia have reportedly launched investigations into Grok.

French and Malaysian authorities are investigating Grok for generating sexualized deepfakes | TechCrunch
https://techcrunch.com/2026/01/04/french-and-malaysian-authorities-are-investigating-grok-for-generating-sexualized-deepfakes/

The issue in question is users who use Grok to alter photos posted on X into sexually explicit images without obtaining permission from the 'photo poster' or 'photo subject.' The following post was made by Kyoichiro , a game streamer, who had his own photo edited by Grok. You can see the edited image in the reply section.




Gravure idol Himeka Niitani and others have been warning people about this issue.




According to a report by Futurism , Grok also generated images of women appearing to be assaulted, images with degrading words written on women's bodies, and incestuous images.

This has become a global problem, and Elon Musk of xAI , the developer of Grok and X, has warned that 'anyone who uses Grok to create illegal content will face the same consequences as if they had uploaded illegal content.'




@Safety, the official account for releasing X's safety tools, also reposted Musk's post, warning, 'We will take action against illegal content, including child sexual abuse material (CSAM) on X, including removal, permanent suspension, and cooperation with local governments and law enforcement as necessary. Anyone who uses Grok to create or facilitate the creation of illegal content will face the same penalties as uploading illegal content. For more information on our policy, please see the full X Rules and various enforcement options on our help page.'




India's IT Ministry said it had ordered X to take steps to restrict Grok from generating 'obscene, pornographic, vulgar, indecent, sexually explicit, pedophilic or any other content prohibited by law.'

France's Paris prosecutor's office has also announced it will investigate the proliferation of sexually explicit deepfakes on X. Politico reports that three government ministers have reported 'clearly illegal content' to the prosecutor's office and the government's online monitoring platform, calling for its immediate removal.

The Malaysian Communications and Multimedia Commission (CMMC) released a statement on Facebook saying, 'We are very concerned by the complaints we have received from members of the public about X's misuse of AI tools, specifically the digital manipulation of images of women and minors to create obscene, deeply offensive or harmful content.' 'We are currently investigating the online harms on X.'


In response to this incident, there has been a lot of discussion on X about how to deal with Grok's image editing feature. The best solution is to 'avoid posting images on X.'




Related Posts:

in AI, Posted by logu_ii