Tech giants agree to child safety principles around generative AI

23 April 2024, 15:34

Child online safety report
Child online safety report. Picture: PA

Amazon, Google, Meta, Microsoft and OpenAI have signed up to the safety commitments, which are being led by child online safety organisations.

Some of the world’s biggest tech and AI firms have agreed to follow new online safety principles designed to combat the creation and spread of AI-generated child sexual abuse material.

Amazon, Google, Meta, Microsoft and ChatGPT creator OpenAI are among the companies to have signed up to the principles, called Safety By Design.

The commitments have been drawn up by child online safety group Thorn and fellow nonprofit All Tech is Human and sees the firms pledge to develop, deploy and maintain generative AI models with child safety at the centre in an effort to prevent the misuse of the technology in child exploitation.

The principles see firms commit to develop, build and train AI models that proactively address child safety risks, for example by ensuring training data does not include child sexual abuse material, as well as maintaining safety after their release by staying alert and responding to child safety risks that emerge.

Generative AI tools such as ChatGPT have become the key area of development within the technology sector over the last 18 months, with an array of AI models and content generation tools being developed and launched by the major firms.

The rapid rise has seen social media and other platforms flooded with AI-generated words, images and videos, with many online safety groups warning of the implications of more fake and misleading content being seen and spread online.

Earlier this year, children’s charity the NSPCC warned that young people were already contacting Childline about AI-generated child sexual abuse material.

Speaking about the new agreed principles, Dr Rebecca Portnoff, vice president of data science at Thorn, said: “We’re at a crossroads with generative AI, which holds both promise and risk in our work to defend children from sexual abuse.

“I’ve seen first-hand how machine learning and AI accelerates victim identification and child sexual abuse material detection. But these same technologies are already, today, being misused to harm children.

“That this diverse group of leading AI companies has committed to child safety principles should be a rallying cry for the rest of the tech community to prioritise child safety through Safety by Design.

“This is our opportunity to adopt standards that prevent and mitigate downstream misuse of these technologies to further sexual harm against children. The more companies that join these commitments, the better that we can ensure this powerful technology is rooted in safety while the window of opportunity is still open for action.”

By Press Association

More Technology News

See more More Technology News

European Space Agency astronaut Tim Peake (PA)

No limit to ChatGPT searches ‘remarkable’ given environmental impact – Tim Peake

The Grok X AI logo is displayed on a mobile phone with Grok seen in the background

Elon Musk's chatbot that praised Hitler was 'trained to use his personal beliefs'

Top view of the Milky Way galaxy showing the estimated orbits of both our Sun and the 3I/ATLAS comet

Mysterious space object may be oldest comet ever discovered, scientists say

Children with multiple long-term health issues undergo severe emotional stress at the same time as they are trying to cope with the physical challenges of their conditions, a study has found (Dominic

Children’s social media activity ‘highlights stress of living with health issue’

Scientists at Sheffield Hallam university have developed a new technique which they describe as a "powerful double weapon" to prevent cancer patients losing their hair during chemotherapy.

New technique hailed as ‘powerful double weapon’ against chemotherapy hair loss

Elon Musk

Elon Musk says his new AI model ‘better than PhD level in everything’

President of France Emmanuel Macron with Sir Keir Starmer

UK and France agree ‘Entente Technologique’ to help protect infrastructure

SHANGHAI, CHINA - JUNE 18, 2025 - The Nvidia logo displayed on a smartphone in Shanghai, China on June 18, 2025. (Photo by CFOTO/Sipa USA)

Nvidia becomes world’s most valuable listed company at $4trn

Surgical Robot

Robot performs realistic surgery ‘with 100% accuracy’

Peter Kyle outside the BBC smiling

Government makes deal with Google to provide free tech for UK public services

Former Wimbledon line judge Pauline Eyre

Wimbledon technology change ‘has turned officials into glorified butlers’

The Grok X AI logo is displayed on a mobile phone with Grok seen in the background

Elon Musk's Grok chatbot forced to delete a slew of posts after praising Adolf Hitler

Linda Yaccarino, chief executive officer (CEO) of X Corp. attends the ceremony for the signing of S.146, The TAKE IT DOWN Act at the White House in Washington, DC.

X CEO quits just two years after she was hired by Elon Musk

Exhibitor Meta showcasing the Ray-Ban Meta AI glasses at the annual British Educational Training and Technology conference at ExCeL London

Meta opens Cambridge lab as part of AI glasses expansion

Palantir NHS contract

Doctors against Palantir’s NHS software put ‘ideology over patient interest’

A woman looking stressed

More than half of people who acted on social media financial advice ‘lost money’