Recent statistics reveal a troubling increase in the number of UK children reporting explicit deepfake images featuring their likenesses, signalling a growing concern for online safety as artificial intelligence tools become more accessible. The Report Remove service, which enables children to flag inappropriate content, disclosed that it had received 420 reports in just the first half of this year—already surpassing the total for the entirety of 2025.
A Disturbing Trend
The rise in reports highlights the alarming ease with which digital manipulation tools, including AI-driven nudification software, can be employed to create harmful content. According to the Internet Watch Foundation (IWF), which operates the Report Remove service in collaboration with the NSPCC, the increase in flagged images is indicative of a broader issue: the vulnerability of children in an age where benign photographs can be exploited and transformed into explicit material.
Dan Sexton, Chief Technology Officer at the IWF, emphasised the challenges of safeguarding children against such practices. “If someone can take a benign image of a child from the internet and create child sexual abuse material with it, there is nothing that child can do to stop it from happening,” he stated. This underscores the pressing need for both parents and tech companies to take proactive measures to protect children’s online presence.
Nature of the Reports
The Report Remove initiative has seen a significant uptick in incidents reported by under-18s, necessitating the addition of a specific checkbox for deepfakes on its submission forms. Many of these reports, according to the IWF, have met the threshold for child sexual abuse material (CSAM), which is illegal in the UK. The government has introduced stringent regulations against the use of AI to create or distribute such material, yet the rising number of incidents suggests that enforcement remains a challenge.
Rani Govender, an online safety expert with the NSPCC, articulated her concerns about the implications of this trend. “This rise in children reaching out because fake or AI-generated sexual images have been created of them is alarming but also sadly predictable,” she noted. Govender’s comments call attention to the urgent need for tech companies to embed robust safety features in their AI products to avert the creation of explicit content.
The Threat of Sextortion
Alongside the disturbing trend of deepfake reports, Sexton revealed that some victims have encountered sextortion, where blackmailers threaten to publish manipulated images unless they receive financial compensation or additional explicit photos. Such tactics not only exploit the victims psychologically but also highlight the necessity for comprehensive educational measures regarding digital safety for children and their guardians.
The Report Remove service functions as a critical resource for young people, enabling them to anonymously report intimate images shared without their consent. By converting flagged images into a digital fingerprint, the service collaborates with major tech platforms to ensure that these images are taken down promptly, safeguarding children from further exploitation.
Guidance for Parents and Guardians
The alarming rise in AI-enabled deepfakes has prompted authoritative bodies like the National Crime Agency and the IWF to issue warnings about the potential risks associated with posting identifiable images of children online. They advise parents to adopt stricter privacy settings on social media accounts and to restrict the sharing of children’s images to trusted networks only. Additionally, schools have been encouraged to remove identifiable images of students from websites and social media to mitigate risks.
The implications of these measures are profound as cybercriminals increasingly target schools and families, scraping images to create harmful content. The call to action for parents and guardians is clear: vigilance and proactive measures are essential in protecting children in the digital landscape.
Why it Matters
The surge in reports of deepfake imagery among children underscores a critical intersection of technology and child safety that demands immediate attention. As AI tools become more sophisticated and accessible, the potential for misuse escalates, posing significant threats to the welfare of the youngest internet users. It is imperative for tech companies, educators, and parents to collaborate and establish a safer online environment, ensuring that children can navigate the digital world without fear of exploitation. The future of online safety depends on our collective responsibility to safeguard vulnerable populations against emerging technological threats.
