**
A concerning trend has emerged in the UK, with a notable increase in reports from children regarding explicit deepfake images featuring their likenesses. The Report Remove service, dedicated to helping individuals flag and remove intimate content, has disclosed that it received 420 reports of such instances in just the first half of this year. This figure has already surpassed the total number of reports for the entirety of 2025, highlighting an alarming trajectory in the proliferation of manipulated imagery.
A Disturbing Trend in Digital Manipulation
The rise of artificial intelligence (AI) tools has made it alarmingly easier to create explicit content that includes the faces of minors. The Internet Watch Foundation (IWF), which oversees the Report Remove service in collaboration with the NSPCC, has expressed serious concerns regarding the implications of these developments. Dan Sexton, the IWF’s Chief Technology Officer, pointed out that the capacity to take innocuous photos of children from the internet and digitally alter them into explicit material poses a significant threat.
“There is little that a child can do to prevent this from occurring, other than refraining from sharing images of themselves online,” Sexton explained. This stark reality underscores the challenges posed by advanced technology that can manipulate images with unprecedented ease.
New Measures in Reporting and Awareness
In response to the growing number of reports, Report Remove has adapted its submission process by introducing a specific checkbox for users to indicate when images are deepfakes. This change aims to streamline the reporting process for minors who find themselves victims of such digital crimes. Sexton articulated the urgency of addressing this issue, stating, “The figures underscore our fears that AI capabilities would evolve, resulting in the manipulation of real individuals’ images.”
Moreover, Sexton confirmed that many of the manipulated images flagged to Report Remove have crossed the threshold into what qualifies as child sexual abuse material (CSAM), which is illegal in the UK. The government has taken steps to legislate against the creation and dissemination of AI-generated abuse material, underscoring the seriousness of the issue.
The Role of Technology Companies
The NSPCC’s Rani Govender echoed these sentiments, emphasising the responsibility of tech companies to integrate rigorous safety measures into their AI products. “The increase in children reaching out due to fake or AI-generated sexual images is alarming yet, unfortunately, predictable,” she remarked. “It is imperative that tech companies stop releasing AI products without robust protections that prevent the creation of such materials in the first place.”
In addition to the immediate concerns regarding explicit content, Sexton noted that some of the individuals who reported manipulated images have been victims of sextortion, where blackmailers threaten to release the material unless they receive payment or more explicit images.
Protecting Children in the Digital Age
Report Remove serves as a vital resource for children, allowing them to anonymously report intimate images or videos that have been misused or may appear online. The service works by converting flagged images into a “hash,” which acts as a digital fingerprint, enabling major tech platforms to remove or block these images from circulation.
In light of the rising incidents of deepfake exploitation, authorities including the National Crime Agency and the IWF have urged parents and guardians to exercise caution regarding the sharing of identifiable images of their children online. They recommend making social media accounts private and sharing photos within a restricted audience to mitigate the risks associated with cybercriminals who scrape online content to create abusive material.
Why it Matters
The surge in reports of deepfake images highlights a critical intersection of technology and child safety, raising urgent questions about the responsibilities of tech companies and society at large. As AI capabilities continue to advance, the potential for misuse grows exponentially, placing vulnerable individuals, particularly children, at heightened risk. This situation calls for immediate action from both industry players and regulatory bodies to implement stronger safeguards, ensuring that the digital landscape remains a safe space for all. The time for proactive measures is now, as the stakes for the youngest members of our society have never been higher.
