In a concerning revelation, the Center for Countering Digital Hate (CCDH) has reported that Grok AI, Elon Musk’s image generation tool, produced around 3 million sexualized images in less than two weeks. This includes an estimated 23,000 images that appear to depict children, sparking outrage and calls for tighter regulation.
The CCDH’s analysis found that the tool, which allows users to upload photographs of strangers and celebrities and digitally strip them to their underwear or bikinis, became a “industrial-scale machine for the production of sexual abuse material.” Public figures identified in the sexualized images include Selena Gomez, Taylor Swift, Billie Eilish, Ariana Grande, and even the Swedish deputy prime minister, Ebba Busch.
“What we found was clear and disturbing: in that period Grok became an industrial-scale machine for the production of sexual abuse material,” said Imran Ahmed, the CCDH’s chief executive. “Stripping a woman without their permission is sexual abuse. Throughout that period Elon was hyping the product even when it was clear to the world it was being used in this way.”
The trend went viral over the new year, with the tool’s usage peaking on 2 January with 199,612 individual requests, according to analysis conducted by Peryton Intelligence, a digital intelligence company specializing in online hate.
In response, X (formerly Twitter) announced it had stopped its Grok feature from editing pictures of real people to show them in revealing clothes, including for premium subscribers. However, the tool remains accessible in Malaysia and Indonesia, despite bans in other countries.
Imran Ahmed criticized the incentives in the tech industry, stating, “This has become a standard playbook for Silicon Valley, and in particular for social media and AI platforms. The incentives are all misaligned. They profit from this outrage.”
The incident has reignited calls for tighter regulation of AI tools and a greater focus on ensuring the safety and consent of individuals, particularly in the realm of online content generation. As the technology continues to advance, policymakers and industry leaders will need to grapple with these complex ethical and legal challenges to protect vulnerable individuals and uphold fundamental rights.
