Indonesia temporarily blocks Grok chatbot over risk of AI‑generated sexual imagery

Indonesia has temporarily blocked Elon Musk's Grok chatbot over the risk of AI‑generated pornographic content, becoming the first country to deny access to the tool. xAI, the startup behind Grok, said it was restricting image generation and editing to paying subscribers while it tried to fix safeguard lapses that had allowed sexualised outputs, including depictions of scantily clad children.

Grok had switched off its image creation function for the vast majority of users on Friday after widespread outcry, though the function remained available to paying subscribers. Communications and digital minister Meutya Hafid said the government views non‑consensual sexual deepfakes as a serious violation of human rights, dignity and the security of citizens in the digital space, and the ministry has summoned X officials to discuss the matter.

Governments, researchers and regulators from Europe to Asia have criticised the app and opened inquiries. Musk said on X that anyone using Grok to make illegal content would face the same consequences as if they had uploaded illegal material. xAI replied to Reuters with what appeared to be an automated message reading 'Legacy Media Lies', and X did not immediately respond to requests for comment.

Australia's prime minister Anthony Albanese called such use 'abhorrent', and Australia's eSafety Office said reports remain small but have recently increased and that it would use powers including removal notices under the Online Safety Act.

Key Topics

Tech, Grok, Indonesia, Xai, Elon Musk, Meutya Hafid