Grok becomes unavailable in Malaysia due to non-consensual sexual content on X (formerly Twitter)
Twitter (formerly Twitter) has been criticized for using a generative AI called Grok to manipulate images of women and children without their consent.
Musk's Grok AI Blocked in Indonesia, Malaysia Over Sexual Images - Bloomberg
https://www.bloomberg.com/news/articles/2026-01-11/musk-s-grok-ai-blocked-in-indonesia-malaysia-over-sexual-images
Grok is blocked in 2 countries over explicit AI images | AP News
https://apnews.com/article/grok-malaysia-indonesia-block-c7cb320327f259c4da35908e1269c225
Indonesia Does What Others Are Still Debating: Blocks Grok AI Over Harmful Deepfakes | IBTimes
https://www.ibtimes.com/indonesia-does-what-others-are-still-debating-blocks-grok-ai-over-harmful-deepfakes-3795017
Fortune Tech: Grok blocked, Instagram data leak, Walmart Wing expansion | Fortune
https://fortune.com/2026/01/12/indonesia-malaysia-temporarily-block-grok/
Malaysia restricts access to Grok AI as backlash over sexualized images widens | Reuters
https://www.reuters.com/business/media-telecom/malaysia-restricts-access-grok-ai-backlash-over-sexualized-images-widens-2026-01-12/
Indonesia and Malaysia block Grok over nonconsensual, sexualized deepfakes | TechCrunch
https://techcrunch.com/2026/01/11/indonesia-blocks-grok-over-non-consensual-sexualized-deepfakes/
In December 2025, the image editing function of Grok, a generative AI developed by xAI, became available on X (formerly Twitter). As a result, there have been numerous cases of people editing other people's images to make them sexually explicit on X. In response, it has been reported that authorities in India, France, and Malaysia have launched investigations into X and Grok. Furthermore, some investigations have indicated that Grok generates approximately 6,700 sexually explicit images every hour.
Authorities in India, France, and Malaysia launch investigations into Grok, a generative AI that can also be used on X, after the image editing function could generate sexual images of children and women - GIGAZINE
Then, on January 10th, Indonesia became the first country in the world to block access to Grok.
Indonesia becomes first country to block access to Grok due to the spread of non-consensual sexual images - GIGAZINE
Following Indonesia, Malaysia also temporarily blocked access to Grok on January 11, 2026. The Malaysian Communications and Multimedia Commission said Grok had been 'repeatedly misused' to generate obscene, sexually explicit and non-consensual doctored images, including of women and minors.
The Communications and Multimedia Commission (CMMC) explained that it had issued a notice to X and xAI calling for stronger safeguards, stating that 'the restrictions are imposed as a preventative and appropriate measure while legal and regulatory proceedings are ongoing.' The block will not be lifted until effective safeguards are in place.
Malaysia, a Muslim-majority country, has strict laws regarding online content, including a ban on obscene and pornographic content. In recent years, Malaysia has responded to the increase in harmful content by strengthening its oversight of internet companies, and is even considering banning users under the age of 16 from accessing social media.
The UK media regulator, Ofcom , has also launched an investigation into whether Grok broke the law by allowing users to share sexual images of children.
Ofcom's Technology Secretary Liz Kendall called the images generated by Grok a 'weapon of abuse' and said the center-left Labour government would investigate the issue, saying it was a crime for companies to provide tools to create nude images without consent. Kendall said that depending on the outcome of the investigation, X and xAI could be fined by Ofcom up to 10% of their global revenue.
On January 9th, xAI, the developer of Grok, restricted the image editing features of Grok to paid members only.
X's AI image editing function will be partially paid - GIGAZINE
In addition, American politicians have sent an open letter to the CEOs of Apple and Google, who run the official smartphone app stores, calling for the removal of Grok and X apps from the Apple and Google app stores.
US politicians send open letter calling for the removal of Grok and X apps from Apple and Google's app stores because they 'mass-produce illegal sexual images' - GIGAZINE
・Continued
UK regulators investigate X over Grok sexual image generation - GIGAZINE
Related Posts:
in AI, Web Service, Posted by logu_ii