The Indian government has ordered Elon Musk-led social media platform X to immediately remove obscene, vulgar and unlawful content, particularly material created using X’s AI service Grok, and to face legal action if it fails to comply.
The Ministry of Electronics and Information Technology (MeitY) issued a formal notice to the Chief Compliance Officer for India operations of X, citing breaches of due diligence obligations under the Information Technology Act, 2000, and the IT Rules, 2021. The company has been directed to remove or disable access to all content in violation of Indian law and to ensure any evidence is preserved.
The order followed a complaint from Rajya Sabha member Priyanka Chaturvedi, who raised concerns about Grok being misused to create vulgar photographs of women and circulate them on social media. The ministry said it had received repeated reports that categories of content on X may not meet legal standards relating to decency and obscenity.
India X Grok regulation: what the order requires
Under the instruction, X must:
- Remove or disable access to offending content without delay, in line with timelines set out in the IT Rules, 2021.
- Take action against users and accounts responsible for hosting, generating, publishing or sharing obscene material.
- Submit a detailed action taken report to MeitY within 72 hours of the order.
MeitY highlighted that the Grok AI service was being exploited to create fake accounts and synthetic images or videos that denigrate women. The ministry described this as a serious platform-level failing that enabled the gross misuse of artificial intelligence to produce indecent material.
Authorities emphasised that misuse was not confined to fake accounts. Women who publish their own images were also vulnerable, as malicious prompts and image manipulation techniques produced derogatory synthetic outputs. The ministry said platform safeguards and enforcement mechanisms had not been adequate to prevent such conduct.
The notice reiterates the government’s expectations of social media companies to maintain statutory due diligence and to act swiftly to remove unlawful material. It warned that non-compliance would be treated seriously and could lead to strict legal consequences for the US-based firm.
The directive follows a December 29 instruction from MeitY asking social media firms to review their compliance frameworks and take action against obscene and unlawful content. The latest order signals a more assertive approach to regulating AI-driven services and protecting users, particularly women, from image-based abuse.
Legal experts say the move will test how platforms balance innovation with regulatory obligations. For companies deploying generative AI, the order underscores the need for robust content moderation, stronger identity verification for accounts, and clearer safeguards to prevent abusive uses of synthetic media.
The coming days will show whether X responds promptly to the notice and how the company adjusts its Grok service and enforcement practices in India. MeitY’s demand for a swift action taken report places the onus on the platform to demonstrate concrete steps to curb misuse and to protect users under Indian law.
Key Takeaways:
- India issues a directive to X to remove obscene and unlawful content generated via its Grok AI, with a 72-hour compliance report required under IT Rules, 2021.
- The move follows complaints about Grok being used to create and share vulgar images of women, prompting concerns over platform safeguards and women’s safety.
- MeitY has directed X to disable offending content, act against user accounts, and face legal consequences for non-compliance under India X Grok regulation.
