A significant rise in the number of UK children reporting explicit deepfake images of themselves has alarmed safety watchdogs and sparked a call for enhanced protective measures against digital exploitation. The Report Remove service, which enables children to flag intimate images that have been manipulated or misused online, revealed that it received 420 reports from minors in just the first half of this year—surpassing the total number reported throughout 2025.
An Alarming Trend
The digital landscape is increasingly fraught with dangers, as new technologies make the creation of explicit content easier than ever before. The Report Remove service, operated by the Internet Watch Foundation (IWF) in partnership with the NSPCC, has noted a particularly concerning trend: the manipulation of innocent images into explicit deepfakes. This year alone, the number of reports from children has already exceeded last year’s total, signalling a troubling escalation in the misuse of technology.
Dan Sexton, the chief technology officer at the IWF, highlighted the ease with which benign images can be transformed into harmful content. “If someone can take a benign image of a child from the internet and create child sexual abuse material with it, there is nothing that child can do to stop it from happening apart from preventing anyone from taking pictures of them—or not putting pictures of themselves online,” he stated. This stark reality underscores the urgency for parents and guardians to be vigilant.
The Role of Technology
The increasing sophistication of AI tools is a double-edged sword. While they have the potential to revolutionise various industries, they simultaneously pose significant risks, especially to vulnerable populations like children. Sexton expressed concern that the capabilities of AI would continue to advance, leading to a greater incidence of manipulated images featuring real individuals. “This is one of the harms we were worried about when we first saw AI image generators being used,” he said.
In response to the rising number of reports, Report Remove has adapted its online submission form to include a checkbox allowing children to specifically flag images as deepfakes. This change aims to facilitate the identification of manipulated content and expedite its removal from online platforms.
Legal Framework and Recommendations
The IWF’s monitoring of child sexual abuse material (CSAM) indicates that many of the reports made to Report Remove are serious enough to meet the thresholds for CSAM. The UK government has established strict legal measures against the creation and distribution of AI-generated abusive material. Rani Govender, an online safety expert at the NSPCC, urged tech companies to implement stronger safeguards in their AI products to prevent the generation of such harmful content. “Tech companies cannot keep pushing out AI products without embedding strong protections that prevent this material from being created in the first place,” she insisted.
Additionally, the rise of deepfake technology has prompted authorities, including the National Crime Agency, to advise parents on best practices for safeguarding their children’s images. They recommend keeping social media accounts private and sharing pictures only within trusted circles to mitigate risks.
Addressing the Impact of Sextortion
Unfortunately, the manipulation of images is not just a standalone issue; it is often linked to an increase in sextortion—where victims are threatened with the publication of explicit material unless they meet certain demands. This troubling phenomenon has further complicated the landscape of online safety for youth, making it all the more crucial for children and parents to remain vigilant.
Report Remove offers a vital service that allows minors to anonymously flag intimate images that have been misused, turning these images into a digital fingerprint or “hash.” This hash is shared with major tech platforms, which can then take action to remove or prevent the upload of similar content.
Why it Matters
The surge in reports of explicit deepfakes among children not only highlights the urgent need for enhanced digital safety measures but also serves as a wake-up call for society as a whole. As technology continues to evolve, we must adapt our strategies for protecting the most vulnerable members of our community. Increased awareness, robust legal frameworks, and proactive measures from tech companies are essential to combat this alarming trend. The stakes are high, and ensuring the safety of our children in the digital age is a responsibility we all share.