The UK’s safeguarding minister has urged law enforcement to aggressively pursue individuals using Elon Musk’s Grok to create disturbing deepfake images of children.
Jess Phillips expressed her concerns to The Mirror, emphasizing the need for accountability as outrage mounts over the misuse of X platform’s artificial intelligence tool, Grok. The software has faced criticism for producing manipulated images, including unauthorized depictions of minors.
Phillips condemned the existence of such features, highlighting the detrimental impact on individuals’ lives. Following an announcement by X (previously known as Twitter) that Grok’s deepfake capabilities would be restricted to paying users, Phillips criticized this move as insufficient.
She stressed the importance of law enforcement’s intervention in prosecuting those involved in generating or disseminating such harmful content. Phillips emphasized that individuals found in possession of such material could face severe penalties of up to a decade in prison.
Regarding the decision to limit Grok’s services to premium users, Phillips dismissed it as inadequate. She called for proactive measures from X to comply with regulations and prevent the dissemination of non-consensual and degrading imagery.
The minister highlighted the legal obligation of social media platforms to promptly remove objectionable content to avoid significant fines imposed by the regulatory body Ofcom. She underscored the government’s firm stance against child sexual abuse, emphasizing that the law unequivocally prohibits the creation, possession, or distribution of AI-generated abusive images.
Notable figures like Maya Jama have also demanded action to halt the generation of unauthorized images. Proposed legislation aims to criminalize the production and dissemination of deepfake images involving children, with potential penalties of up to five years in prison.
Labour’s strategy against violence targeting women and girls commits to outlawing apps that facilitate the creation of deepfake images without consent. Phillips reaffirmed the government’s intentions to swiftly enforce legislation against the illicit use of tools like Grok for generating intimate deepfakes.
Ofcom recently raised concerns with Musk’s X and xAI regarding the creation of sexualized images of minors using Grok. In response, Grok’s official account acknowledged lapses in safeguards and assured prompt corrective actions to address illegal content.
Musk reiterated that individuals engaging in illicit activities through Grok would face legal consequences akin to uploading illegal content. The focus remains on ensuring accountability and safeguarding against the exploitation of AI technologies for harmful purposes.