Google and OpenAI back new online safety tools to combat child sexual abuse

10 February 2025, 15:04

Man on a smartphone walks down some stairs past a line up of different flags
France AI Summit. Picture: PA

The initiative will help firms that are unable to afford or build safety mechanisms access technology to detect, review and report child sexual abuse.

Google, OpenAI and children’s gaming platform Roblox are among the firms backing a new initiative to provide free online safety tools to firms around the globe.

The initiative, known as Robust Open Online Safety Tools (Roost), will help firms otherwise unable to afford or build their own safety mechanisms gain access to technology to help detect, review and report child sexual abuse material, and use AI to help power other safety features.

The scheme has also been backed by former Google chief executive Eric Schmidt, online messaging platform Discord and several academic and research organisations, and was announced during the first day of the AI Action Summit in Paris.

The summit is hosting world leaders, tech firms and academics for a range of talks on the future of AI and how the technology can be used in a range of fields including sustainability and safety, as well as how it could impact society.

EU-France-AI-Summit-Canada
People take part in the Artificial Intelligence Action Summit at the Grand Palais in Paris (Sean Kilpatrick/The Canadian Press via AP)

Mr Schmidt said the scheme “addresses a critical need to accelerate innovation in online child safety and AI by providing small companies and non-profits access to technologies they currently lack”.

He said the “collaborative, open-source approach” would help “foster innovation”, and help create a “safer internet for everyone”.

The summit is being attended by tech figures including Google boss Sundar Pichai and OpenAI chief executive Sam Altman, as well as a number of world leaders and senior figures including US Vice President JD Vance and Indian Prime Minister Narendra Modi, with many nations looking to use the summit to showcase their own potential leadership of the AI space.

Prime Minister Sir Keir Starmer has chosen not to attend the two-day summit, but Technology Secretary Peter Kyle is in Paris to represent the UK and said he would be using the trip to encourage more investment in the UK’s AI infrastructure and “cement our position as an AI pioneer”.

French President Emmanuel Macron, who is hosting the summit, announced ahead of its opening on Monday that companies were planning to invest around £91 billion in AI projects in France in the coming years.

By Press Association

More Technology News

See more More Technology News

People protest outside the proposed site of the new Chinese Embassy in London

China’s proposed ‘super embassy poses super risk’ to security, Tories claim

Sir Elton John performing

Elton John says ‘we will not back down’ in awards speech addressing AI concerns

Live
Customers purchase Nintendo Switch 2 at an electronics retailer in Tokyo on June 5, 2025.

Nintendo Switch 2 launch live: Where to buy, best deals, and early verdict

In this photo illustration, an Apple logo is seen displayed alongside the Google logo.

Tech giants Apple and Google 'profiting from phone thefts', MPs claim

A man's hands using a laptop keyboard

Scots warned of ‘scamdemic’ as £860,000 lost to cyber criminals in 12 months

A close up image of a The North Face fleece

North Face and Cartier customer data stolen in cyber attacks

Imagery of a Zilch payments card and a virtual card

Buy now pay later provider Zilch to launch first physical card

UK’s most EV-friendly city has been revealed by new research.

Cities with slowest EV charging times and least amount of chargers revealed

View of a VodafoneThree logo outside the firm's offices

Vodafone completes Three UK mega-merger to form ‘new force’ in mobile market

A hand holding a Monzo bank card and a mobile phone showing the Monzo app

Monzo annual profit surges as paying subscribers boost digital bank

Majestic British Airways Airbus A380 taking off from London Heathrow at sunset, amazing colors

UK airspace shake-up could slash journey times and cut flight delays for millions of passengers

File photo dated 30/05/25 of the saltmarsh at Abbotts Hall in Essex. Saltmarshes are 'significant' carbon stores, but are at risk from rising sea levels, new research reveals

UK's muddy saltmarshes vital to tackle climate change, report finds

Nigel Farage

Reform backs cryptocurrency tax cut as party receives first Bitcoin donations

Digital devices on office workplace table of young business woman

‘Young people and black workers at highest risk of workplace surveillance’

Debris from the Titan submersible, recovered from the ocean floor near the wreck of the Titanic, is unloaded from the ship Horizon Arctic at the Canadian Coast Guard pier in St. John's, Newfoundland, in June 2023

The shock household item discovered in 'sludge' of OceanGate sub wreckage

Google is facing a £25 billion legal claim in the UK, accusing the tech giant of abusing its dominant position in the online search advertising market

Google facing £25 billion legal claim over abuse of search advertising market