Tech firms vow to tackle ‘shocking’ AI-generated child sex abuse images

30 October 2023, 17:04

A person using a laptop
Online abuse. Picture: PA

Home Secretary Suella Braverman hosted an event to combat such ‘depraved’ material.

Tech giants including TikTok and Snapchat have signed a pledge vowing to tackle the spread of artificially generated images of child sex abuse.

Home Secretary Suella Braverman hosted the companies, as well as charities, academics and representatives of the UK and Australian governments at an event on Monday to address the “shocking” spread of AI-generated material depicting children being abused.

It comes after an internet safety organisation warned that the realistic imagery risks normalising sexual violence against children.

The pictures are computer-generated but they often show real people – it’s depraved and damages lives

Home Secretary Suella Braverman

The images, although computer-generated, are often based on real material, “revictimising” the survivors of that past abuse, the Internet Watch Foundation (IWF) said.

The event, held in partnership with the IWF, was taking place before Rishi Sunak’s AI Safety Summit at Bletchley Park later this week.

Ms Braverman said: “Child sexual abuse images generated by AI are an online scourge. This is why tech giants must work alongside law enforcement to clamp down on their spread. The pictures are computer-generated but they often show real people – it’s depraved and damages lives.

“The pace at which these images have spread online is shocking and that’s why we have convened such a wide group of organisations to tackle this issue head-on. We cannot let this go on unchecked.”

IWF data found that thousands of child sex abuse pictures could be found on the dark web and are realistic enough to be treated as real imagery under UK law.

The organisation, which works to identify and remove online images and videos of child abuse, said the AI-generated material could make it harder to spot when real children might be in danger.

IWF chief executive Susie Hargreaves said: “The realism of these images is astounding, and improving all the time. The majority of what we’re seeing is now so real, and so serious, it would need to be treated exactly as though it were real imagery under UK law.

“It is essential, now, we set an example and stamp out the abuse of this emerging technology before it has a chance to fully take root. It is already posing significant challenges.”

The joint statement signed by tech companies including OnlyFans and Stability AI pledged to sustain “technical innovation around tackling child sexual abuse in the age of AI”, according to the Home Office.

The statement affirms that AI must be developed in “a way that is for the common good of protecting children from sexual abuse across all nations”.

Other signatories included the NSPCC, National Crime Agency and National Police Chiefs’ Council.

The Government is looking into further investment into using AI to combat child sexual abuse.

It already uses the technology to sort through large volumes of data and grade the severity of the material, helping police identify offenders and safeguard children, the Home Office said.

NSPCC chief executive Sir Peter Wanless said: “Already we are seeing AI child abuse imagery having a horrific impact on children, traumatising and retraumatising victims who see images of their likeness being created and shared. This technology is giving offenders new ways to organise and risks enhancing their ability to groom large numbers of victims with ease.

“It was important to see child safety on the agenda today. Further international and cross-sector collaboration will be crucial to achieve safety by design.”

By Press Association

More Technology News

See more More Technology News

Sir Elton John performing

Elton John says ‘we will not back down’ in awards speech addressing AI concerns

Live
Customers purchase Nintendo Switch 2 at an electronics retailer in Tokyo on June 5, 2025.

Nintendo Switch 2 launch live: Where to buy, best deals, and early verdict

In this photo illustration, an Apple logo is seen displayed alongside the Google logo.

Tech giants Apple and Google 'profiting from phone thefts', MPs claim

A man's hands using a laptop keyboard

Scots warned of ‘scamdemic’ as £860,000 lost to cyber criminals in 12 months

A close up image of a The North Face fleece

North Face and Cartier customer data stolen in cyber attacks

Imagery of a Zilch payments card and a virtual card

Buy now pay later provider Zilch to launch first physical card

UK’s most EV-friendly city has been revealed by new research.

Cities with slowest EV charging times and least amount of chargers revealed

View of a VodafoneThree logo outside the firm's offices

Vodafone completes Three UK mega-merger to form ‘new force’ in mobile market

A hand holding a Monzo bank card and a mobile phone showing the Monzo app

Monzo annual profit surges as paying subscribers boost digital bank

Majestic British Airways Airbus A380 taking off from London Heathrow at sunset, amazing colors

UK airspace shake-up could slash journey times and cut flight delays for millions of passengers

File photo dated 30/05/25 of the saltmarsh at Abbotts Hall in Essex. Saltmarshes are 'significant' carbon stores, but are at risk from rising sea levels, new research reveals

UK's muddy saltmarshes vital to tackle climate change, report finds

Nigel Farage

Reform backs cryptocurrency tax cut as party receives first Bitcoin donations

Digital devices on office workplace table of young business woman

‘Young people and black workers at highest risk of workplace surveillance’

Debris from the Titan submersible, recovered from the ocean floor near the wreck of the Titanic, is unloaded from the ship Horizon Arctic at the Canadian Coast Guard pier in St. John's, Newfoundland, in June 2023

The shock household item discovered in 'sludge' of OceanGate sub wreckage

Google is facing a £25 billion legal claim in the UK, accusing the tech giant of abusing its dominant position in the online search advertising market

Google facing £25 billion legal claim over abuse of search advertising market

A hand holding a phone showing the Nvidia logo

Nvidia posts strong growth despite ongoing tariff challenges