Grok obscene AI content: govt. gives X time till January 7 to submit report

By Admin

07 Jan, 2026

Introduction
The Indian government has taken a strong stand against the misuse of artificial intelligence tools on social media platforms, particularly concerning the generation of obscene and sexually explicit content. In a significant development, the Centre has granted Elon Musk-led platform X additional time till January 7, 2026, to submit a detailed Action Taken Report (ATR) on steps taken to curb illegal content generated through AI services such as Grok.

Government Issues Stern Warning to X
The Ministry of Electronics and Information Technology (MeitY) issued a stern warning to X on January 2, directing the platform to immediately remove all vulgar, obscene, indecent and unlawful content, especially content generated using its built-in AI interface, Grok. The government highlighted that Grok was being misused by users to create fake accounts and generate or share obscene images and videos of women in a derogatory manner.

According to the Ministry, this misuse was not limited to fake accounts alone. It also involved targeting women who host or publish their own images or videos, which were then manipulated using AI prompts, image alteration techniques and synthetic outputs. The Ministry described this as a serious failure of platform-level safeguards and enforcement mechanisms.

Extension Granted After X Seeks More Time
Initially, X was asked to submit a detailed Action Taken Report within 72 hours of the January 2 directive, effectively by January 5. However, government sources confirmed that X sought additional time from the IT Ministry. Accepting the request, the Centre extended the deadline and asked the platform to submit its report by January 7, 2026.

The report is expected to outline the technical and organisational measures adopted or proposed to address misuse of Grok, the role of the Chief Compliance Officer, actions taken against offending content and users, and mechanisms to ensure compliance with mandatory reporting requirements under Indian law.

X Responds on Content Safety
On Sunday, January 4, 2026, X’s official Safety handle stated that the platform would take action against illegal content, including Child Sexual Abuse Material (CSAM). The measures include removing illegal content, permanently suspending violating accounts, and cooperating with local governments and law enforcement agencies wherever necessary.

X also reiterated Elon Musk’s stance, stating that anyone using or prompting Grok to create illegal content would face the same consequences as users who upload illegal content directly to the platform.

Concerns Over Violation of IT Laws
The IT Ministry noted that regulatory provisions under the Information Technology Act and the IT Rules, 2021, were being flouted by X, particularly with respect to obscene, indecent, vulgar, pornographic, paedophilic and other unlawful content. The Ministry expressed grave concern that such acts violate the dignity, privacy and safety of women and children, normalise sexual harassment in digital spaces, and undermine India’s statutory due diligence framework for intermediaries.

The government made it clear that compliance with the IT Act and its rules is not optional. It emphasised that safe harbour protection under Section 79 of the IT Act is conditional upon strict adherence to due diligence obligations. Any failure to comply could result in loss of immunity and further action under the IT Act and the Bharatiya Nyaya Sanhita.

Clear Directions and Compliance Requirements
In its January 2 letter, the Ministry directed X to strictly desist from hosting, displaying, uploading, publishing, transmitting, storing or sharing any content that is obscene, pornographic, vulgar, indecent, sexually explicit or otherwise prohibited by law. The platform was also instructed to enforce its user terms of service and AI usage restrictions, including strong deterrent actions such as suspension or termination of violating accounts.

Additionally, X has been asked to remove or disable access to all illegal content already generated or disseminated, without delay and in line with timelines prescribed under the IT Rules, 2021, while preserving evidence.

The Action Taken Report must demonstrate ongoing, auditable compliance with Indian laws, failing which the government warned that appropriate legal action could be initiated.

Global Scrutiny on Grok
India is not alone in raising concerns over Grok’s capabilities. Authorities in the United Kingdom and Malaysia have also criticised the platform. The UK’s communications regulator, Ofcom, recently stated that it was aware of serious concerns regarding Grok producing undressed images of people and sexualised images of children.

Ofcom confirmed that it has made urgent contact with X and xAI to understand the steps taken to comply with UK legal obligations. Based on the response, the regulator will assess whether further investigation is warranted.

Conclusion
The extension granted to X until January 7 underscores the seriousness with which the Indian government is treating the misuse of AI-generated content. As AI tools become more powerful and accessible, regulators are increasingly holding platforms accountable for ensuring user safety and legal compliance. The coming days will be crucial in determining how X addresses these concerns and whether its response satisfies the government’s strict due diligence requirements.