The Indian government has issued a stern warning to X, the social media platform owned by Elon Musk, after authorities found that the Grok feature was being used to produce obscene images of women. The Ministry of Electronics and Information Technology (MeitY) wrote to X’s chief compliance officer, directing the platform to carry out an immediate and thorough review of Grok and to remove or disable access to unlawful content.
Grok AI India government action
In its letter, the ministry said the Grok service available on X was being used to create and distribute insulting, obscene and sexually explicit images and videos of women. The ministry described this as a serious misuse of AI technology and a failure of platform-level safety systems. It urged X to take concrete measures to prevent the hosting, creation, publication, broadcasting, sharing or uploading of such content.
MeitY specifically asked X to ensure immediate compliance and to submit a report detailing the steps taken to address the problem. The ministry said the misuse amounted to a violation of relevant laws and regulations and warned that failure to comply could lead to strict legal action against the platform, its responsible officers and users who breach the law.
The notice referenced enforcement under the Information Technology Act and the rules framed thereunder, as well as provisions of the Indian Penal Code. It made clear that non-compliance would be treated seriously and could result in action without further notice.
Platform safety experts say this action highlights growing concerns about generative tools that can create realistic but fabricated imagery. Regulators are increasingly calling on platforms to anticipate misuse and to build stronger preventive controls, including content moderation, rate limits, safeguards on model outputs, and clear reporting and takedown procedures.
X has previously faced scrutiny from regulators in several countries over content moderation and compliance. The Indian ministry’s demand underscores the expectation that social platforms must proactively police automated features that can enable harm, particularly when they facilitate the exploitation or humiliation of vulnerable groups.
For users and advocates, the ministry’s move may be welcomed as recognition of the harms caused by deepfake and synthetic sexual content. Women’s rights groups have long warned about the reputational and psychological damage that can result when platforms fail to prevent the spread of such material.
The ministry’s letter did not specify a public deadline for compliance, but it clearly sought an immediate and comprehensive response. Observers will be watching whether X implements additional safeguards on Grok, some of which could include stricter access controls, content filters, or temporary disabling of features pending an audit.
As governments worldwide consider how best to regulate generative tools, the case in India is likely to be cited as an example of national authorities insisting on accountability from global platforms. The outcome may influence how technology firms design and deploy such features in jurisdictions with strict content and safety laws.
Key Takeaways:
- India’s Ministry of Electronics and Information Technology has warned X over Grok AI generating obscene images of women.
- The ministry demanded immediate removal or disabling of access to such content and asked for a compliance report.
- Authorities warned of legal action under the Information Technology Act and Indian Penal Code if the platform fails to act.
