Children across the UK are increasingly reporting explicit deepfake images of themselves, raising alarms about the dangers posed by advanced artificial intelligence technologies. The Report Remove service, a crucial tool for safeguarding young users from online exploitation, has revealed that in just the first half of this year, it received a staggering 420 reports from children claiming their likenesses were digitally manipulated to create inappropriate content. This figure has already surpassed the total number of similar reports for all of 2025, underscoring a troubling trend in digital safety.
Alarming Increase in Reports
The Report Remove service, managed by the Internet Watch Foundation (IWF) in collaboration with the NSPCC, has noted a dramatic rise in cases of deepfake imagery. These reports involve images that have been altered using AI tools, which can easily turn benign photographs into explicit, harmful content. Dan Sexton, the IWF’s chief technology officer, expressed deep concern over the implications of this technology. “If someone can take a benign image of a child from the internet and create child sexual abuse material with it, there is nothing that child can do to stop it from happening apart from preventing anyone from taking pictures of them – or not putting pictures of themselves online,” he stated.
The staggering statistic of 420 reports in just six months reflects a growing urgency in addressing this issue. In response to the rising tide of manipulated images, Report Remove has introduced a feature allowing young users to specifically classify the material as deepfaked, thus streamlining the reporting process.
The Role of AI in Image Manipulation
Sexton highlighted the troubling reality that the capabilities of AI are becoming increasingly sophisticated, facilitating the creation of harmful content. “This is one of the harms we were worried about when we first saw AI image generators being used,” he remarked, noting that the potential for misuse is vast. He added, “Everyone in the world is at risk.”
The IWF has reported that many instances of manipulated imagery reported in 2025 and 2026 were so severe that they met the threshold for child sexual abuse material (CSAM), which is illegal in the UK. The government has enacted strict laws against the creation and distribution of AI-generated abuse material, yet the technology continues to evolve at a rapid pace.
Urgent Call for Enhanced Safety Measures
Rani Govender, an online safety expert at the NSPCC, emphasised the need for tech companies to implement stronger safety measures in their AI products. “This rise in children reaching out because fake or AI-generated sexual images have been created of them is alarming but also sadly predictable,” she said. “Tech companies cannot keep pushing out AI products without embedding strong protections that prevent this material from being created in the first place.”
The issue has also led to reports of sextortion, where victims are blackmailed with threats of releasing manipulated images unless they comply with demands for money or further explicit content. Report Remove serves as a vital resource for children to anonymously flag such instances, transforming flagged images into a digital fingerprint that can be shared with major tech platforms for removal.
The Importance of Online Caution
In light of these alarming developments, authorities, including the National Crime Agency and IWF, are urging parents and guardians to be vigilant about their children’s online presence. They recommend keeping identifiable images of children off public platforms, suggesting that social media accounts be set to private or that photos be shared only within trusted circles. Schools have also been advised to eliminate identifiable images of students from their websites and social media to mitigate risks.
Why it Matters
The growing frequency of deepfake reports among children highlights a critical intersection of technology, safety, and ethics. As AI tools become more accessible and powerful, the potential for misuse escalates, posing unprecedented risks to young users. This situation underscores the urgent need for robust safeguards and responsible practices from tech companies, parents, and educators alike. By addressing these challenges head-on, we can foster a safer digital environment for the next generation.
