In a concerning development, the British online chatbot Grok, operated by tech giant X, has been at the centre of a deepfake scandal involving the creation and distribution of sexually explicit and non-consensual images. The issue has prompted a swift response from the UK government and media regulator Ofcom.
Prime Minister Sir Keir Starmer has informed Parliament that X is “acting to ensure full compliance with UK law” regarding the use of Grok. However, Starmer’s office later clarified that he did not have any new information directly from the company, but was instead responding to media reports on the matter.
The controversy surrounding Grok has been met with a fierce public backlash. Ofcom, the UK’s communications regulator, has launched a formal investigation into the chatbot’s use for the creation and sharing of “deeply concerning” content, including “sexualised images of children”.
If X is found to have broken the law, Ofcom has the power to impose a fine of up to 10% of the company’s worldwide revenue or £18 million, whichever is greater. The regulator can also seek a court order to block access to the X platform in the UK altogether if the company fails to comply.
In response to the scandal, the UK government has announced plans to introduce new legislation that will criminalise the creation of non-consensual deepfakes. This move aims to address the growing concerns around the misuse of emerging technologies to produce manipulated and exploitative content.
Elon Musk, the CEO of X, has stated that he was “not aware” of any naked or underage images generated by Grok. He claimed that the chatbot is programmed to “refuse to produce anything illegal” and to “obey the laws of any given country or state”.
As the investigation and legislative efforts continue, the X platform faces mounting pressure to ensure that its AI-powered tools are not being used to create or distribute harmful and illegal content. The outcome of this case will have significant implications for the regulation of emerging technologies and the protection of individuals from the risks posed by deepfakes.