Grok Gone Wrong: Calls for Ofcom to Clamp Down on Deepfake Dangers on X

The UK government has taken a firm stance against unlawful AI images generated on the social media platform X, urging Ofcom to utilize its regulatory powers, potentially leading to a ban on the site. These actions are driven by alarming reports of X’s AI tool, Grok, which has been reportedly used to create deepfake images that remove clothing, including sexualized representations of children. Prime Minister Sir Keir Starmer condemned these practices as “disgraceful” and urged Ofcom to act decisively, stating, “It’s unlawful. We’re not going to tolerate it.”

Ofcom has the authority, under the Online Safety Act, to obtain court orders to restrict X’s access to funding and technological support if it can prove serious risks, particularly to children. Although Ofcom has exercised its powers sparingly, it is now expected to adopt a more proactive approach, especially with the appointment of a new chair to guide its efforts in internet safety.

In light of these concerns, Ofcom has connected urgently with X and xAI, the company responsible for Grok, to address the issue. Currently, sharing deepfake images in the UK is illegal, and X has stated that users will face consequences for creating illegal content through Grok. The government expresses unwavering support for Ofcom’s endeavors to eradicate such hazardous technologies, reflecting a growing urgency to safeguard children and the broader public from the implications of AI misuse.

As the government pushes for accountability and compliance, the case spotlights the broader implications of AI technology in today’s digital landscape and its potential to disrupt public safety.