Creating or attempting to create non-consensual intimate images will now be considered a criminal offense, as the prevalence of sexualized deepfakes on Elon Musk’s X platform has surged. Liz Kendall, the Technology Secretary, labeled the AI-generated images by X’s chatbot Grok as tools of abuse, prompting an official investigation by Ofcom.
During a parliamentary address, Kendall announced the implementation of a new law that prohibits the creation or pursuit of non-consensual, intimate images, effective immediately. Additionally, applications enabling the creation of fake nude images will be outlawed under the Crime and Policing Bill currently advancing through Parliament. This legislative measure aims to prevent the distribution of tools designed for generating non-consensual online content.
Simultaneously, Ofcom initiated an inquiry to determine if X has violated its legal responsibilities under the Online Safety Act. In case of non-compliance, Ofcom has the authority to impose fines on X, formerly known as Twitter, amounting to £18 million or up to 10% of its global revenue. Furthermore, the regulatory body can enforce business sanctions, such as compelling payment providers or advertising services to disengage from the platform.
Kendall emphasized the severe impact of non-consensual image sharing, stating that such content can cause immense harm to individuals, particularly women and girls. She urged Ofcom to swiftly conclude its investigation, underlining the urgency of addressing the issue promptly. Moreover, Kendall hinted at potentially reassessing government engagement with X following calls from certain MPs to discontinue the use of the platform.
At a Labour Party gathering, Keir Starmer strongly condemned the actions of Grok and X, denouncing their prioritization of abusive users over protecting victims. He affirmed the government’s commitment to upholding values and safeguarding the vulnerable from exploitation. Starmer asserted that if X fails to control Grok effectively, the government will intervene promptly to ensure accountability and prevent harm.
Following concerns raised by Ofcom regarding the creation of sexualized images of children on X’s platform by Grok, the regulatory body swiftly initiated an investigation. The Internet Watch Foundation reported the discovery of inappropriate content involving minors, allegedly produced using Grok. Musk’s acknowledgment of lapses in safety measures and the commitment to addressing the issue were highlighted in a recent statement.
In response to criticisms, X announced a paid service for creating deepfakes through Grok, drawing backlash for what was perceived as an insensitive move. The government and Kendall condemned this approach as an attempt to profit from abusive content, indicating a lack of regard for victims of exploitation.