A significant rise in the number of UK children reporting explicit deepfake images featuring their likenesses has emerged, highlighting a growing concern over the misuse of artificial intelligence in creating harmful content. According to the Report Remove service, an initiative dedicated to helping minors combat online exploitation, there have been 420 reported instances of children flagging manipulated images of themselves in just the first half of 2026. This figure surpasses the total for the entire year of 2025, revealing a troubling trend in digital safety.
Alarming Trends in Digital Safety
The Report Remove service, which operates under the auspices of the Internet Watch Foundation (IWF) and the NSPCC, is designed to assist children in reporting intimate images that have been shared without their consent or manipulated inappropriately. As technology advances and tools for producing explicit content become more accessible, the challenges of safeguarding young individuals online are intensifying.
Dan Sexton, the IWF’s chief technology officer, expressed concerns regarding the ease with which benign images can be transformed into exploitative material. “If someone can take a benign image of a child from the internet and create child sexual abuse material with it, there is nothing that child can do to stop it from happening apart from preventing anyone from taking pictures of them,” he stated. This stark reality underscores the urgent need for enhanced protective measures in the digital realm.
The Role of AI in Image Manipulation
The rise in reported deepfakes coincides with the proliferation of advanced AI tools that can manipulate images with alarming efficiency. The IWF has observed that many of the flagged images fall into the category of child sexual abuse material (CSAM), which is illegal in the UK. The government has already taken steps to criminalise the creation and distribution of AI-generated CSAM, yet the existing safeguards may not be sufficient to keep pace with the rapid evolution of technology.
Sexton noted that the increasing capability of AI to generate realistic images raises significant concerns. “This is one of the harms we were worried about when we first saw AI image generators being used, that they would be used to create child sexual abuse material featuring real children,” he remarked, emphasising that the threat extends beyond individual victims, affecting society at large.
The Impact on Victims and the Call for Action
The implications of this alarming trend are far-reaching. Some children who have reported manipulated images have been victims of sextortion, where perpetrators threaten to publish explicit content unless the victim complies with their demands. The Report Remove service offers a crucial lifeline, allowing minors to anonymously flag inappropriate content and work towards its removal from the internet.
Rani Govender, an online safety expert at the NSPCC, has called for technology companies to implement stronger protections within their AI products to prevent the creation of explicit material. “This rise in children reaching out because fake or AI-generated sexual images have been created of them is alarming but also sadly predictable,” she commented, urging tech firms to embed robust safeguards to mitigate these risks.
Parental Guidance and Preventative Measures
In response to the escalating threat of AI-enabled deepfakes, the National Crime Agency and IWF have issued guidance for parents and guardians. They advise keeping identifiable images of children private on social media and sharing them only within trusted circles. The authorities have also warned of instances where cybercriminals have attempted to blackmail educational institutions by leveraging AI to create CSAM from publicly available images.
As schools are encouraged to remove identifiable pictures of pupils from their websites, it becomes clear that a collective effort is required to safeguard children from these emerging threats.
Why it Matters
The surge in reports of explicit deepfakes among children is a stark reminder of the vulnerabilities young individuals face in an increasingly digital world. As AI technologies continue to evolve, so too do the methods employed by those seeking to exploit them. Establishing stronger protective measures, alongside fostering awareness among parents, educators, and children, is imperative to combat the rising tide of digital exploitation. The responsibility lies not just with technology firms, but with society as a whole to ensure a safer online environment for the next generation.