Nations agree to develop shared risk thresholds for AI as Seoul summit closes

22 May 2024, 12:34

A person using a laptop
Institute for Public Policy Research analysis. Picture: PA

Twenty-seven nations, including the UK and US, as well as the EU have signed up to the new agreement.

Twenty-seven nations and the European Union have signed a new agreement to create shared risk thresholds around the development of artificial intelligence (AI) to close the Seoul summit on the safety of the technology.

The agreement will see the countries develop an internationally recognised threshold for AI model capabilities and when it should be considered it poses a severe risk without appropriate mitigations.

That risk could include the potential for AI to help malicious actors acquire or use chemical and biological weapons, or by the technology attempting to evade human oversight through deception.

The agreement, known as the Seoul Ministerial Statement, was signed at the conclusion of the AI Seoul Summit in South Korea, which the UK has co-hosted.

Alongside the UK and South Korea, the United States, France, and the UAE were among those to sign up to the agreement, However China, which was involved in the summit talks, did not sign the statement.

Technology Secretary Michelle Donelan said: “It has been a productive two days of discussions which the UK and the Republic of Korea have built upon the ‘Bletchley Effect’ following our inaugural AI Safety Summit which I spearheaded six months ago.

“The agreements we have reached in Seoul mark the beginning of phase two of our AI safety agenda, in which the world takes concrete steps to become more resilient to the risks of AI and begins a deepening of our understanding of the science that will underpin a shared approach to AI safety in the future.

“For companies, it is about establishing thresholds of risk beyond which they won’t release their models.

“For countries, we will collaborate to set thresholds where risks become severe. The UK will continue to play the leading role on the global stage to advance these conversations.”

As part of the agreement, the signatories have now set the target of developing the risk proposals alongside AI companies, civil society and academia, so that they can be discussed at the AI Action Summit, which is due to be hosted by France in 2025.

The announcement follows agreements also being reached on the first day of the summit which saw 16 leading AI companies from around the world commit to publishing safety frameworks on how they will approach specific risks around AI, and a second agreement between 10 nations and the EU to create an international network of AI safety institutes that will share research and other data.

By Press Association

More Technology News

See more More Technology News

Passengers queue outside Stansted airport in Essex

What are air passengers entitled to during IT outage flight disruption?

A payslip

Payroll software halted by global IT outage, say businesses

A cash only sign on the window of a Cambridge shoe shop

Shops report not being able to take card payments amid IT outage

A warning message on the NHS app displayed on a phone

Streeting urges patients to ‘bear with’ GPs as outage sparks major disruption

Passengers queue at Birmingham Airport

Air passengers told to go home if flight cancelled following global IT outage

The home page of Cybersecurity firm CrowdStrike

IT outage fix deployed but ‘some time’ before all systems restored – CrowdStrike

GP surgery stock

IT outage impacts two-thirds of GP practices in Northern Ireland

A plane flying at night

More flight cancellations and delays expected in wake of global IT outage

IT outages

Global IT outage: What happened and when will it be fixed?

A warning message on the NHS app

GPs and pharmacies say global IT outage disruption to continue over weekend

A fifth of parents believe social media might be better suited to teach their children about money than they are according to a survey for Santander UK (Tim Goode/PA)

20% of parents ‘think social media is better at teaching children about money’

Bombay Bicycle Club

Bombay Bicycle Club reschedule festival date they missed due to global IT outage

A man gestures with his hands

IT outage ‘likely’ to occur again unless government and industry work together

IT outages

Air passengers facing further disruption following world IT outage

A laptop user with their hood up

AI-generated child sex abuse images are based on real victims, report finds

A warning message on the NHS app displayed on a phone

NHS warns of continued disruption to GP services next week from global IT outage