**
In a troubling development, the Internet Watch Foundation (IWF) has reported a blackmail attempt against a secondary school in the UK, illustrating the growing risks posed by the misuse of artificial intelligence (AI) in the realm of child safety online. With criminals increasingly exploiting images sourced from school websites and social media to create explicit content, experts are urging educational institutions to reassess their policies regarding the publication of student photographs.
A New Era of Online Threats
The IWF’s findings underscore a significant shift in the tactics employed by blackmailers. Following the manipulation of images of schoolchildren, these criminals demanded payment from the institution, threatening to disseminate the generated explicit material if their demands were not met. This incident, which occurred late last year, has raised alarm bells across the educational sector.
Jess Phillips, the minister for safeguarding and violence against women and girls, described these attempts as a “deeply worrying emerging threat,” emphasising the need for updated legislation to address the evolving landscape of AI-generated explicit content. The government has already announced measures aimed at banning the possession of AI models capable of producing child sexual abuse material (CSAM), indicating a proactive stance against such criminal activities.
Urgent Recommendations for Schools
In light of these incidents, the National Crime Agency (NCA) and child safety advocates are advising schools to eliminate identifiable images of students from their online platforms. The recommendations include replacing clear photographs with alternative images such as blurred or distant shots, thus reducing the potential for misuse. The IWF notes that 150 images from the recent blackmail case were classified as CSAM under UK law, highlighting the severity of the situation.
The early warning working group (EWWG), an advisory body focused on combatting online harms, has provided guidance urging schools to reconsider their practices around publishing images of pupils. The EWWG suggests that institutions should evaluate whether images featuring children’s faces are necessary at all, advocating for safer methods of celebrating student achievements without compromising their safety.
Tackling the Sextortion Epidemic
The phenomenon of sextortion—where individuals are coerced into providing explicit material under threat of exposure—has seen a marked increase, particularly as generative AI tools become more prevalent. In many cases, victims are manipulated into sharing intimate images, which are then weaponised against them. Reports indicate that sextortion has tragically led to the suicides of several British teens, a stark reminder of the real-world consequences of such online threats.
According to the Report Remove service, which allows minors to flag explicit content that could surface online, instances of sextortion have risen sharply, with a 34% increase in reports from under-18s in the past year alone. This alarming trend underscores the urgency for schools and parents alike to adopt more stringent measures for online safety.
Proactive Measures and Community Responsibility
In response to the escalating threat, some educational institutions have already begun implementing precautionary measures. The Loughborough Schools Foundation, for example, revamped its website to remove identifiable student images, setting a precedent for others to follow. The Confederation of School Trusts (CST), representing a significant number of schools across England, has committed to carefully evaluating the guidance provided by the EWWG, striving to find a balance between celebrating student achievements and ensuring their safety.
In a statement, CST Chief Executive Leora Cruddas lamented the necessity of navigating such threats, asserting that celebrating children’s accomplishments should not come with the risk of exposing them to potential harm.
Why it Matters
The rise of AI-driven blackmail and sextortion presents a profound challenge for educational institutions, parents, and policymakers alike. As technology evolves, so too do the tactics of those seeking to exploit it for nefarious purposes. The recommendations from child safety experts serve as a crucial call to action for schools to adapt their online practices, prioritising the safety of students in an increasingly digital world. By taking proactive steps now, we can mitigate these risks and create a safer environment for the next generation.
