Is X on the Brink? UK Government Threatens to Strip Platform of Self-Regulation Amid AI Image Scandal

In a striking move, the UK government is set to implement new legislation making it illegal to create non-consensual intimate images, amid growing concerns over Elon Musk’s Grok AI chatbot. During a briefing with Labour MPs, Sir Keir Starmer warned that if X (formerly Twitter) fails to manage Grok effectively, it could lose its right to self-regulate. He emphasized that the government is prepared to intervene swiftly to address these issues.

As part of the government’s initiative, legislation will also make it illegal to supply online tools that facilitate the creation of such images. The BBC reached out to X for comments, to which the platform responded that anyone using Grok to produce illegal content would face the same repercussions as if they had uploaded illegal content directly.

This announcement follows Ofcom’s decision to initiate an investigation into X over alarming reports regarding Grok’s capability to manipulate images of individuals. If found guilty of breaking the law, X could face fines reaching up to 10% of its global revenue or £18 million—the greater of the two. In addition, refusal to comply might lead to court orders blocking UK access to X.

Technology Secretary Liz Kendall urged Ofcom to expedite its investigation, which is already under pressure from campaigners who have accused the government of delaying the enforcement of legislation aimed at preventing the dissemination of deepfakes. While it is currently illegal to share such altered images in the UK, enforcement of new provisions from the Data (Use and Access) Act, established in June 2025, hasn’t progressed as promptly as hoped.

Kendall announced that the new offences regarding the sharing of intimate images without consent would be prioritized under the Online Safety Act, characterizing AI-generated explicit content—especially of women and children—as tools of abuse rather than mere novelties. She vehemently affirmed that sharing intimate images without consent is not only immoral but will also be prosecuted as a crime against individuals and platforms alike.

Highlighting the critical role of social media platforms in preventing such content, she stressed that X and similar entities must be held accountable for any illegal material circulating on their sites. In future enhancements to legislation, the government intends to criminalize nudification apps, targeting the source of the problem directly.

Legal expert, Jamie Hurworth, noted that the government’s stance reflects a serious commitment to addressing the issue, though concerns remain regarding police resource availability for the anticipated investigations.

Examples of digitally altered images on X have surfaced, including shocking cases where women were depicted in explicit scenarios without their consent. Ofcom’s investigation will scrutinize X’s response to these incidents, particularly its speed and effectiveness in managing illegal content.

The UK government’s actions follow international criticism towards Grok’s functionalities, prompting temporary bans in countries like Malaysia and Indonesia. Elon Musk, responding to criticisms, argued that the UK government is leveraging these issues as a pretext for censorship, a stance that Kendall disputed, clarifying that the agenda is centered on protecting women and girls from digital violence.

Opposition voices in Parliament, such as Shadow Technology Secretary Julia Lopez, welcomed the investigation but criticized the drastic measures under consideration, expressing concern about blocking access to X, a platform with significant potential for positive societal impacts.

Samuel wycliffe