In a concerning development, the standalone version of the Grok AI tool, known as Grok Imagine, remains accessible through a web browser and continues to allow users to generate highly sexualized videos of women, even after restrictions were announced by Elon Musk’s social media platform, X.
Guardian reporters found that the standalone Grok Imagine app still responds to prompts to digitally remove the clothes from images of fully clothed women, going so far as to create short videos simulating a “sexually provocative striptease.” This workaround appears to circumvent the restrictions X claimed to have implemented to prevent the misuse of the Grok AI tool.
The continued ease of access to these “nudification tools” has raised alarm among advocacy groups, with Rebecca Hitchen of the End Violence Against Women Coalition stating that “X isn’t taking the issue of online violence against women and girls seriously enough.” Hitchen has called on the UK government and media regulator Ofcom to pressure X and other platforms to stop the proliferation of image-based sexual abuse.
The controversy has also drawn the attention of authorities in other countries, with Canada’s privacy watchdog and officials in the Philippines and Malaysia all taking action to investigate or block the use of Grok.
Despite the outrage, Elon Musk has seemingly sought to capitalize on the increased attention, claiming that the “popularity and real-world usage” of Grok is “skyrocketing globally.” The UK government, however, has reiterated its commitment to tackling the issue, stating that the Online Safety Act already requires platforms like X to prevent illegal content, including nonconsensual intimate images and child abuse material, from appearing on their services.
The government has also announced plans to introduce a “nudification” offence, which will specifically target tools designed to generate nonconsensual intimate images. This move underscores the determination of policymakers to address the growing concerns surrounding the misuse of AI-powered tools like Grok.
As the investigation by Ofcom continues, the public and authorities alike will be closely watching to ensure that X and other tech companies take robust and immediate action to prevent the exploitation of women and girls online.