A new law will make it a crime to produce or attempt to produce non-consensual intimate images starting this week, as the prevalence of sexualized deepfakes on Elon Musk’s platform rises. Technology Secretary Liz Kendall labeled the images generated by X’s AI chatbot Grok as tools of abuse, prompting Ofcom to launch a formal investigation into the social media platform.
During a parliamentary session, Kendall informed lawmakers that the legislation outlawing the creation or pursuit of non-consensual intimate images will be enforceable imminently. Additionally, applications enabling the fabrication of fake nude images of individuals will face legal consequences under the Crime and Policing Bill currently advancing through Parliament. This new offense will prohibit companies from providing tools designed for generating non-consensual internet images, aiming to address the issue at its root.
Meanwhile, media regulator Ofcom’s inquiry will determine if X, formerly known as Twitter, has failed to meet its legal responsibilities under the Online Safety Act. Potential penalties for non-compliance include fines of up to £18 million or 10% of global revenue, along with other measures like compelling payment providers or advertising services to disassociate from the platform.
Kendall emphasized the severity of the issue, stating that non-consensual images circulating online can cause severe harm, particularly towards women and girls. Urging swift action, she urged Ofcom to expedite its investigation, stressing that victims and the public expect decisive measures. Moreover, she signaled the government’s readiness to reassess engagement with X following calls from some MPs to discontinue using the platform.
At a Labour Party gathering, Keir Starmer denounced Grok’s actions on X as reprehensible, prioritizing the protection of victims over abusive users. Starmer affirmed the government’s commitment to upholding values and safeguarding the vulnerable. Ofcom recently raised concerns about Grok’s potential to produce sexualized images of children, prompting an urgent investigation to ensure compliance with UK regulations, especially regarding child protection.
The Internet Watch Foundation reported discovering illicit content involving children on X, allegedly created using Grok. Musk acknowledged the lapses in safeguards, vowing to address them promptly and warning of consequences for any misuse of the platform. In response, X announced that access to Grok for creating deepfakes will be a paid service, drawing criticism for monetizing abusive content.