The Indian government has strongly warned social media site X (previously Twitter) about  the spread of pornographic content created by artificial intelligence on its platform. The  Center has warned that X may lose its “safe harbor” protection under Indian law if it  disregards removal orders pertaining to such content, according to a story by The Economic  Times. 

The warning is significant since X has already had its legal immunity revoked for failing to  comply with India’s information technology standards. The present issue is the purported  abuse of Grok, X’s AI chatbot, for creating and sharing offensive pictures and videos,  especially ones that include women. 

Comprehending safe harbor protection 

Section 79 of the Information Technology Act of 2000 provides safe harbor protection. As  long as they scrupulously follow government regulations and respond quickly to legitimate  removal demands, this clause protects internet intermediaries from legal accountability for  user-generated content housed on their platforms. 

X has more stringent compliance requirements since it is a Significant Social Media  Intermediary (SSMI). These include prompt removal of illegal content, strong grievance  redressal procedures, and clear accountability for managing infractions. The platform may be  subject to legal action and lose its statutory protection if these obligations are neglected. 

Why did the government issue the notice? 

The Ministry of Electronics and Information Technology (MeitY) formally notified X on  January 2 in response to allegations that their AI chatbot Grok was being used to produce and  distribute explicit and pornographic content. Concerns over the misuse of generative AI  technologies and the platform’s obligation to stop the spread of such content were expressly  brought up in the warning.

The government ordered X to present a thorough action-taken and compliance report, delete  the detected problematic information within 72 hours, and take action against accounts that  created or shared it. MeitY emphasized that safe harbor status might be revoked if auditable  compliance is not established. 

The government’s increasing emphasis on controlling AI-driven material and making sure  tech companies are held responsible for any abuse that takes place within their ecosystems is  reflected in this action. 

X’s prior difficulties with compliance in India 

In India, X has previously been under regulatory investigation. The platform’s safe harbor  status was temporarily revoked in 2021 due to noncompliance with the Information  Technology (Intermediary Guidelines and Digital Media Ethics Code) Rules, 2021. 

The Delhi High Court noted at the time that the Center had every authority to prosecute the  platform for non-compliance. X’s legal immunity was terminated for over three months,  highlighting the severity of regulatory enforcement, even though it eventually appointed  important compliance officers in India as required by the regulations. 

More extensive effects on digital platforms 

The Indian government’s intention to take a more stringent approach to AI-generated content,  especially when it includes obscenity, user safety, and ethical transgressions, is shown by the  most recent warning to X. It also reaffirms the idea that technology progress must adhere to  current legal and social standards. 

Intermediaries are anticipated to put in place more robust security measures to stop abuse  when AI capabilities are incorporated into social media platforms. Continued non-compliance  might affect X’s operating status in one of its major international markets in addition to  having legal repercussions.