Google and OpenAI back new online safety tools to combat child sexual abuse

10 February 2025, 15:04

Man on a smartphone walks down some stairs past a line up of different flags
France AI Summit. Picture: PA

The initiative will help firms that are unable to afford or build safety mechanisms access technology to detect, review and report child sexual abuse.

Google, OpenAI and children’s gaming platform Roblox are among the firms backing a new initiative to provide free online safety tools to firms around the globe.

The initiative, known as Robust Open Online Safety Tools (Roost), will help firms otherwise unable to afford or build their own safety mechanisms gain access to technology to help detect, review and report child sexual abuse material, and use AI to help power other safety features.

The scheme has also been backed by former Google chief executive Eric Schmidt, online messaging platform Discord and several academic and research organisations, and was announced during the first day of the AI Action Summit in Paris.

The summit is hosting world leaders, tech firms and academics for a range of talks on the future of AI and how the technology can be used in a range of fields including sustainability and safety, as well as how it could impact society.

EU-France-AI-Summit-Canada
People take part in the Artificial Intelligence Action Summit at the Grand Palais in Paris (Sean Kilpatrick/The Canadian Press via AP)

Mr Schmidt said the scheme “addresses a critical need to accelerate innovation in online child safety and AI by providing small companies and non-profits access to technologies they currently lack”.

He said the “collaborative, open-source approach” would help “foster innovation”, and help create a “safer internet for everyone”.

The summit is being attended by tech figures including Google boss Sundar Pichai and OpenAI chief executive Sam Altman, as well as a number of world leaders and senior figures including US Vice President JD Vance and Indian Prime Minister Narendra Modi, with many nations looking to use the summit to showcase their own potential leadership of the AI space.

Prime Minister Sir Keir Starmer has chosen not to attend the two-day summit, but Technology Secretary Peter Kyle is in Paris to represent the UK and said he would be using the trip to encourage more investment in the UK’s AI infrastructure and “cement our position as an AI pioneer”.

French President Emmanuel Macron, who is hosting the summit, announced ahead of its opening on Monday that companies were planning to invest around £91 billion in AI projects in France in the coming years.

By Press Association

More Technology News

See more More Technology News

People ride an upward escalator next to the Dior store at the Icon Siam shopping mall on June 12, 2024 in Bangkok, Thailand.

Luxury fashion giant Dior latest high-profile retailer to be hit by cyber attack as customer data accessed

A plane spotter with binoculars from behind watching a British Airways plane landing

‘Flying taxis’ could appear in UK skies as early as 2028, minister says

Apple App Store

Take on Apple and Google to boost UK economy, think tank says

A survey of more than 1,000 employers found that around one in eight thought AI would give them a competitive edge and would lead to fewer staff.

One in three employers believe AI will boost productivity, research finds

Hands on a laptop showing an AI search

One in three employers believe AI will boost productivity, research finds

Music creators and politicians take part in a protest calling on the Government to ditch plans to allow AI tech firms to steal their work without payment or permission opposite the Houses of Parliament in London.

Creatives face a 'kind-of apocalyptic moment’ over AI concerns, minister says

Ngamba Island Chimpanzee Sanctuary on Lake Victoria, Uganda

Chimps use medicinal plants to treat each other's wounds and practice 'self-care' as scientists hail fascinating discovery

Close up of a person's hands on the laptop keyboard

Ofcom investigating pornography site over alleged Online Safety Act breaches

The Monzo app on a smartphone

Monzo customers can cancel bank transfers if they quickly spot an error

Co-op sign

Co-op to re-stock empty shelves as it recovers from major hack

The study said that it was often too easy for adult strangers to pick out girls online and send them unsolicited messages.

Social media platforms are failing to protect women and girls from harm, new research reveals

Peter Kyle leaves 10 Downing Street, London

Government-built AI tool used to cut admin work for human staff

In its last reported annual headcount in June 2024, Microsoft employed 228,000 full-time workers

Microsoft axes 6,000 jobs despite strong profits in recent quarters

Airbnb logo

Airbnb unveils revamp as it expands ‘beyond stays’ to challenge hotel sector

A car key on top of a Certificate of Motor Insurance and Policy Schedule

Drivers losing thousands to ghost broker scams – the red flags to watch out for

Marks and Spencer cyber attack

M&S customers urged to ‘stay vigilant’ for fraud after data breach confirmed