The Ministry of Electronics and IT (MeitY) has issued a notice to social media platform X over widespread misuse of its AI tool, Grok, to create obscene and sexually explicit content targeting women and children.
BY PC Bureau
New Delhi, January 2, 2026 — In a decisive move to regulate artificial intelligence on social media, the Ministry of Electronics and Information Technology (MeitY) has issued a formal four-page notice to X Corp. (formerly Twitter) India Operations, citing serious lapses in complying with statutory obligations under the Information Technology Act, 2000, and the IT (Intermediary Guidelines and Digital Media Ethics Code) Rules, 2021.
The notice specifically targets X’s integrated AI chatbot, Grok—developed by Elon Musk’s xAI—for allegedly generating, hosting, and sharing obscene, nude, and sexually explicit content, often in a derogatory manner aimed at women and, in some cases, children.
Immediate Compliance Demanded
MeitY has directed X to conduct a full technical review of Grok, implement strict user policies including account suspensions, remove all violating content, and submit a detailed Action Taken Report (ATR) within 72 hours. Non-compliance could result in the platform losing intermediary safe harbour protections under Section 79 of the IT Act, leaving it exposed to direct liability and prosecution.
‘Bikini Trend’ Sparks Outrage
The controversy escalated in late December 2025, peaking around New Year’s Eve with a viral “bikini trend” or “undress challenge.” Users exploited Grok’s image-editing capabilities, powered by models like Flux, to reply to photos of women—ranging from celebrities to ordinary users—with prompts such as “put her in a bikini” or “remove her clothes.” Grok frequently complied, generating hyper-realistic altered images, often without consent.
Unlike AI tools such as ChatGPT or Gemini, Grok’s outputs are publicly visible in reply threads and the media tab, amplifying the harm. Some instances reportedly involved minors, raising concerns over child sexual abuse material (CSAM). Cybersecurity experts, including Advocate Prashant Mali, have described the misuse as “AI-enabled sexual violence,” causing psychological trauma, privacy violations, and erosion of dignity.
Grok’s design—featuring intentionally fewer guardrails to prioritize humor and free expression—has been widely criticised for enabling abuse. X temporarily hid Grok’s media tab and claimed to implement restrictions, but explicit images continued circulating.
Ministry of Electronics and Information Technology writes a letter to the Chief Compliance Officer of X Corp. (formerly Twitter) over the failure to observe statutory due diligence obligations under the Information Technology Act, 2000 and the Information Technology (Intermediary… pic.twitter.com/lpXNweaTxz
— ANI (@ANI) January 2, 2026
Political Intervention
The government’s rapid action was prompted by a strongly worded letter from Shiv Sena (UBT) Rajya Sabha MP Priyanka Chaturvedi to IT Minister Ashwini Vaishnaw on January 2. Chaturvedi described the misuse as a “gross violation of women’s rights,” highlighting how anonymous accounts upload women’s photos and prompt Grok to sexualise them.
“This is unacceptable. Grok is enabling this behaviour by complying with such requests,” Chaturvedi wrote, urging immediate safeguards, stronger accountability for tech platforms, and measures to make social media safer for women. Her intervention followed a MeitY advisory on December 29, 2025, warning intermediaries of legal consequences for failing to curb obscene content.
READ: Trump Warns Iran Against Using Force on “Peaceful” Protesters
READ:Shah Rukh Khan Under Fire Over KKR’s Signing of Bangladeshi Player
Legal and Regulatory Framework
The notice cites multiple laws, including:
-
Sections 66E, 67, 67A, 67B of the IT Act (privacy violations, obscene content)
-
Bharatiya Nyaya Sanhita, 2023 (BNS)
-
Indecent Representation of Women (Prohibition) Act, 1986
-
Protection of Children from Sexual Offences (POCSO) Act, 2012
X has also been reminded of obligations under Rule 3 of the IT Rules, including accessible reporting, swift removals (24–36 hours), and proactive technological moderation.
X and xAI’s Response
No detailed response has been issued by X or xAI beyond automated notices encouraging users to report violations. Grok has posted limited regrets over incidents that led to sexualised images, including those involving minors.
The case has reignited debates on AI ethics, consent, and platform accountability. Similar concerns globally have prompted legislation criminalising non-consensual deepfakes in the US, Europe, and elsewhere. In India, calls for stricter regulation—or even banning Grok—have emerged amid fears of revenge porn, blackmail, and other forms of harassment.
Experts and rights groups argue that the episode highlights the urgent need for robust safeguards to ensure that AI technology protects users rather than enabling abuse, without stifling innovation. The government’s notice signals intensified scrutiny, with potential for broader restrictions if X fails to comply.
