Google and OpenAI back new online safety tools to combat child sexual abuse

10 February 2025, 15:04

Man on a smartphone walks down some stairs past a line up of different flags
France AI Summit. Picture: PA

The initiative will help firms that are unable to afford or build safety mechanisms access technology to detect, review and report child sexual abuse.

Google, OpenAI and children’s gaming platform Roblox are among the firms backing a new initiative to provide free online safety tools to firms around the globe.

The initiative, known as Robust Open Online Safety Tools (Roost), will help firms otherwise unable to afford or build their own safety mechanisms gain access to technology to help detect, review and report child sexual abuse material, and use AI to help power other safety features.

The scheme has also been backed by former Google chief executive Eric Schmidt, online messaging platform Discord and several academic and research organisations, and was announced during the first day of the AI Action Summit in Paris.

The summit is hosting world leaders, tech firms and academics for a range of talks on the future of AI and how the technology can be used in a range of fields including sustainability and safety, as well as how it could impact society.

EU-France-AI-Summit-Canada
People take part in the Artificial Intelligence Action Summit at the Grand Palais in Paris (Sean Kilpatrick/The Canadian Press via AP)

Mr Schmidt said the scheme “addresses a critical need to accelerate innovation in online child safety and AI by providing small companies and non-profits access to technologies they currently lack”.

He said the “collaborative, open-source approach” would help “foster innovation”, and help create a “safer internet for everyone”.

The summit is being attended by tech figures including Google boss Sundar Pichai and OpenAI chief executive Sam Altman, as well as a number of world leaders and senior figures including US Vice President JD Vance and Indian Prime Minister Narendra Modi, with many nations looking to use the summit to showcase their own potential leadership of the AI space.

Prime Minister Sir Keir Starmer has chosen not to attend the two-day summit, but Technology Secretary Peter Kyle is in Paris to represent the UK and said he would be using the trip to encourage more investment in the UK’s AI infrastructure and “cement our position as an AI pioneer”.

French President Emmanuel Macron, who is hosting the summit, announced ahead of its opening on Monday that companies were planning to invest around £91 billion in AI projects in France in the coming years.

By Press Association

More Technology News

See more More Technology News

Brianna Ghey

Social media companies will not put lives before profit – Brianna Ghey’s mother

Facebook

Meta considering subscription option for UK Facebook users

Professor Stephen Hawking

Cambridge University sparks row over claims Stephen Hawking 'benefited from slavery'

Queen's University Belfast Vice Chancellor Professor Sir Ian Greer (left) with Goodloe Sutton, Vice President of Strategy and Advocacy at Boeing Government Operations

Queen’s receives Boeing investment for aerospace engineering research lab

A girl holding a mobile phone while blurred figures sit in the background

Toxic ‘bro’ culture driving Gen Z women from social media, survey suggests

Scanner

New scanner technique may offer hope for patients with drug-resistant epilepsy

Amazon accused of 'pushing propaganda' after mum asks Alexa to name celebrities - and is given list of Republicans

Amazon accused of 'pushing propaganda' after mum asks Alexa for celebrities - and is given Trump, Vance and Musk

Stephen Graham

Adolescence creators accept invitation to discuss online safety with MPs

A Norwegian man filed a complaint against the creators of ChatGPT

Norwegian man calls for fines after ChatGPT ‘hallucinated’ that he’d killed his children

Psychologists gave the more accurate ADHD videos an average rating of 3.6 out of five (PA)

ADHD misinformation on TikTok is widespread and affecting young people – study

A child's hands holding a mobile phone while playing a game

Ad watchdog announces crackdown on degrading images of women in gaming apps

Two hands on a laptop keyboard

Start-up firms established at universities could be lost to overseas competitors

White mobile phone being held in the hands of a young person

Charity declares ‘national childhood emergency’ amid concerns about online harm

Young boys are being targeted in sextortion plots

British teenage boys targeted by Nigerian crime gangs in 'sextortion' plots

Broadband customer survey

Major broadband providers outperformed by smaller rivals in annual survey

Close-up of African office worker typing on keyboard of laptop computer at the table

British teenage boys being targeted by Nigerian ‘sextortion’ gangs