OpenAI forms safety committee as it starts training latest AI model

28 May 2024, 15:24

OpenAI logo
OpenAI New AI Model. Picture: PA

The safety committee arrives as debate swirls around AI safety at the company.

OpenAI said it is setting up a safety and security committee and has begun training a new AI model to supplant the GPT-4 system that underpins its ChatGPT chatbot.

The San Francisco startup said in a blog post on Tuesday that the committee will advise the full board on “critical safety and security decisions” for its projects and operations.

The safety committee arrives as debate swirls around AI safety at the company, which was thrust into the spotlight after a researcher, Jan Leike, resigned and levelled criticism at OpenAI for letting safety “take a backseat to shiny products”.

OpenAI co-founder and chief scientist Ilya Sutskever also resigned, and the company disbanded the “superalignment” team focused on AI risks that they jointly led.

OpenAI said it has “recently begun training its next frontier model” and its AI models lead the industry on capability and safety, though it made no mention of the controversy.

“We welcome a robust debate at this important moment,” the company said.

AI models are prediction systems that are trained on vast datasets to generate on-demand text, images, video and human-like conversation. Frontier models are the most powerful, cutting-edge AI systems.

The safety committee is filled with company insiders, including OpenAI CEO Sam Altman and chairman Bret Taylor, and four OpenAI technical and policy experts. It also includes board members Adam D’Angelo, who is the CEO of Quora, and Nicole Seligman, a former Sony general counsel.

The committee’s first job will be to evaluate and further develop OpenAI’s processes and safeguards and make its recommendations to the board in 90 days.

The company said it will then publicly release the recommendations it is adopting “in a manner that is consistent with safety and security”.

By Press Association

Latest World News

See more Latest World News

Jay Slater's family have shared an image of what is believed to be the last sighting of him

Missing Jay Slater's 'last sighting' in Tenerife: Family share CCTV of mystery figure believed to be teen

Hosts of Izmir Wildlife Park

Mother in 'serious condition' after being viciously mauled by wolf pack during jog through safari park

Tamayo Perry was killed in a shark attack.

Pirates of the Caribbean star mauled to death by shark while surfing in Hawaii

Debbie Duncan with Jay Slater

'I hope I'm not taking him home in a body bag': Jay Slater's mum feels 'let down' by conspiracy theories about her son

Barcelona is set to crack down on Airbnbs

Barcelona announces plans to ban holiday rentals for tourists from 2028

Hungary's Kevin Csoboth, bottom, shoots past Scotland's goalkeeper Angus Gunn, top, during a Group A match between Scotland and Hungary at the Euro 2024 soccer tournament in Stuttgart, Germany, Sunday, June 23, 2024. (AP Photo/Ariel Schalit)

Scotland knocked out of Euro 2024 following Hungary's 100th-minute goal as collision sees star stretchered off

Terror in Russia: Gunmen open fire at two synagogues killing six police before slitting priest's throat at Orthodox Church

Terror in Russia: Gunmen open fire at synagogue and Orthodox churches killing 15 police officers

Detective who probed Nicola Bulley offers services to Jay Slater's family as search for teen enters its second week

Investigator who probed Nicola Bulley offers services to Jay Slater's family as search targets remote buildings

M50 motorway Dublin

'Miracle' as schoolboy, 12, 'lucky to be alive' after toppling from toilet of moving coach onto motorway

Jay

Jay Slater's father and brother make emotional pleas for return of the missing teenager

Jay Slater had travelled to the Canary Islands for a music festival

Jay Slater's mum issues desperate plea after Spanish police reject help in search for missing Brit

Ukrainian President Volodmyr Zelensky has reportedly slammed Nigel Farage for his controversial comments about the West provoking the invasion of the country.

Zelensky says Farage 'infected by Putinism' as Reform leader doubles down on Ukraine comments

Thirteen people have been arrested after a forest fire near Athens which were allegedly started by fireworks coming from a mega-yacht.

13 arrested after Greek mega-yacht allegedly caused forest fires on outskirts

Starmer labels Farage's comments 'disgraceful'

Farage doubles down on Ukraine comments after Sunak and Starmer condemned Reform UK leader

Starmer labels Farage's comments 'disgraceful'

Farage’s comments on Ukraine are ‘disgraceful’, Starmer tells LBC, as PM accuses him of ‘playing into Putin’s hands’

Timberlake was arrested after having dinner with friends on Long Island

Justin Timberlake breaks silence on drink-driving arrest at Chicago concert