Children in the UK are increasingly reporting explicit deepfake images of themselves, highlighting a troubling trend that underscores the challenges of online safety in the age of sophisticated artificial intelligence (AI). The Report Remove service, designed to help users flag intimate images, has recorded an alarming rise in reports from minors, indicating a growing issue that demands urgent attention from tech companies and regulators alike.
Alarming Statistics: A Surge in Reports
In just the first half of this year, Report Remove has received 420 reports from children claiming that their images have been manipulated or digitally altered to create explicit content. This figure already surpasses the total of 397 reports received throughout 2025. This rapid escalation raises significant concerns about the ease with which AI tools can be used to exploit innocent images, transforming them into harmful material that can have severe repercussions for the young victims involved.
Dan Sexton, the chief technology officer at the Internet Watch Foundation (IWF), which operates Report Remove in conjunction with the NSPCC charity, pointed out the inherent challenges in preventing such manipulation. “If someone can take a benign image of a child from the internet and create child sexual abuse material with it, there is nothing that child can do to stop it from happening,” he stated. The stakes are high, as Sexton emphasises a grim reality: the risk of misuse extends to every individual online.
The Role of Technology and Safety Regulations
The rise in reports has prompted Report Remove to implement additional features, including a specific checkbox for users to identify images as deepfakes. This move underscores the growing need for more robust mechanisms to combat this form of digital exploitation. Sexton reiterates a troubling prediction: the advancement of AI capabilities will inevitably lead to an increase in manipulated images of real individuals, posing a significant threat to children and society at large.
The IWF has observed that many of the manipulated images reported fall within the thresholds of child sexual abuse material (CSAM), which is illegal in the UK. The government has enacted stringent laws against adapting AI models to create such material or distributing those models. Yet, experts like Rani Govender from NSPCC stress that tech firms must take proactive measures to integrate stronger safety features into their products to avert the creation of explicit content in the first place. “This rise in children reaching out because fake or AI-generated sexual images have been created of them is alarming but also sadly predictable,” Govender noted.
The Threat of Sextortion
In addition to the distressing nature of these reports, Sexton highlighted the emergence of sextortion cases linked to manipulated images. Victims have faced threats of blackmail, wherein perpetrators demand payments or further explicit images in exchange for not publishing the manipulated content. This represents a particularly insidious use of technology that preys on vulnerable individuals.
The Report Remove service plays a critical role in combating this issue by allowing children to anonymously flag intimate images that could be used against them. By transforming these images into digital fingerprints, or “hashes,” the service collaborates with major tech platforms to take down or prevent the upload of such harmful content. However, the increasing sophistication of AI-generated imagery demands ongoing vigilance from both technology providers and regulatory bodies.
Guidance for Parents and Guardians
Amidst rising concerns, the National Crime Agency and IWF have issued recommendations for parents and guardians to safeguard their children online. They advise keeping identifiable images private and limiting their exposure on social media. The growing number of cybercriminals who scrape online pictures to create malicious content further emphasises the importance of these precautions. Schools are also urged to remove identifiable images from their websites and social media accounts, reflecting a collective responsibility to protect children from the dangers posed by deepfake technology.
Why it Matters
The alarming increase in reported deepfake incidents illustrates a critical intersection of technology and child safety in today’s digital landscape. As AI continues to evolve, so too do the methods employed by those looking to exploit it for harmful purposes. The implications extend beyond individual victims; they pose a significant challenge to societal norms regarding privacy, consent, and the protection of vulnerable populations. It is imperative that tech companies, policymakers, and communities work collaboratively to implement robust safeguards that not only address the symptoms of this crisis but also tackle its root causes. The safety of our children in an increasingly digital world depends on it.
