In a concerning trend, children across the UK are increasingly reporting explicit deepfake images of themselves, with the Report Remove service documenting a staggering 420 cases just in the first half of this year. This figure already surpasses the total from 2025, highlighting a worrying escalation that has safety experts sounding the alarm about the ease with which artificial intelligence (AI) can manipulate images.
The Alarming Rise of Deepfake Reports
The Report Remove initiative, a collaboration between the Internet Watch Foundation (IWF) and the NSPCC, has revealed that children now face a growing risk of having their innocent images digitally altered to create explicit content. The first six months of 2026 have seen these alarming incidents soar, with 420 reports logged from minors claiming their likenesses were manipulated. This sharp increase not only underscores the evolving nature of digital safety but also raises pressing questions about the effectiveness of current protective measures.
Dan Sexton, the IWF’s chief technology officer, emphasised the challenges posed by readily available AI tools. “If someone can take a benign image of a child from the internet and create child sexual abuse material with it, there is nothing that child can do to stop it apart from preventing anyone from taking pictures of them,” he stated. This sobering reality highlights the urgent need for enhanced protective measures in our increasingly digital landscape.
New Reporting Mechanisms for Victims
In response to the rising tide of manipulated images, Report Remove has introduced a new feature that allows young users to specifically flag content as deepfakes when submitting their reports. This proactive step aims to streamline the process of identifying and removing harmful material from the internet.
The IWF has noted that many of the reports submitted over the past two years have met the threshold for child sexual abuse material (CSAM), which is illegal in the UK. The government has implemented strict laws to prevent the misuse of AI in creating such material, reinforcing the seriousness of this issue. According to Sexton, the escalation in reports reflects a broader concern about the potential misuse of AI technology. “This is one of the harms we feared when AI image generators first emerged,” he remarked, indicating that the safety of children is increasingly at risk.
The Role of Technology Companies
Rani Govender, an online safety expert from the NSPCC, called for tech companies to take immediate action by embedding stronger safety features in their AI systems. “This rise in children reaching out because fake or AI-generated sexual images have been created of them is alarming but also sadly predictable,” she noted, urging firms to prioritise safety in their product development processes.
The gravity of this situation is further compounded by reports of victims facing sextortion—a form of blackmail where perpetrators threaten to publish explicit images unless demands for money or further illicit content are met. The Report Remove service provides a vital lifeline, allowing children to anonymously report such incidents while ensuring that harmful content is swiftly dealt with.
Guidance for Parents and Guardians
In light of these developments, authorities like the National Crime Agency and IWF have issued urgent advice to parents and guardians. They recommend keeping identifiable images of children off public platforms and suggest opting for private social media settings or limiting photo sharing to “close friends” groups. This precautionary measure aims to protect children from potential exploitation by cybercriminals who use AI to create CSAM from publicly available images.
Schools are also under pressure to safeguard their students, with recommendations to remove identifiable images from websites and social media accounts. This collective effort aims to strengthen the digital safety net for children and curb the alarming trend of deepfakes.
Why it Matters
The rise in deepfake reports among children is not just a digital nuisance; it poses significant risks to their safety and well-being. As AI technology continues to evolve, it is imperative that both society and technology companies take a stand against the exploitation of minors. By fostering robust protective measures and raising awareness, we can work towards a safer digital environment, ensuring that children can navigate online spaces without fear of manipulation or harm. The urgency of this issue cannot be overstated; the safety of our children depends on it.
