OpenAI unveils tool that can create video from text

16 February 2024, 11:24

The OpenAI logo on a mobile phone in front of a computer screen displaying output from ChatGPT
OpenAI Video Generator. Picture: PA

Sora can generate videos up to a minute in length from a simple, short text description.

OpenAI has unveiled a new tool which can generate short videos based on text prompts.

Called Sora, it is able to create videos up to a minute long based solely on a short text-based description of what the user wants to create.

OpenAI, the maker of ChatGPT, said Sora was being made available to safety testers to “assess critical arears for harms or risks”, as well as being given to a range of “visual artists, designers, and filmmakers” to try out and offer feedback.

“We’re teaching AI to understand and simulate the physical world in motion, with the goal of training models that help people solve problems that require real-world interaction,” OpenAI said of its new tool.

The firm said the model has a “deep understanding of language” which enabled it to “accurately interpret prompts and generate compelling characters that express vibrant emotions”.

But OpenAI said it was also taking “several important safety steps” around Sora ahead of making it more widely available.

It said it was “red teaming” the tool, meaning it was being tested for vulnerabilities and its ability to be exploited, and was adding a detection classifier to the metadata of Sora videos which identifies it as content created by AI.

Video examples of Sora in action on the OpenAI website also included a watermark, identifying the content as being AI-generated – an important tool in combating misinformation.

The ChatGPT maker added: “We’ll be engaging policymakers, educators and artists around the world to understand their concerns and to identify positive use cases for this new technology.

“Despite extensive research and testing, we cannot predict all of the beneficial ways people will use our technology, nor all the ways people will abuse it.

“That’s why we believe that learning from real-world use is a critical component of creating and releasing increasingly safe AI systems over time.”

Earlier this week, the company revealed that it had detected and removed several state-backed groups using its AI tools for malicious activities, including working on content to be used in phishing attacks.

OpenAI and a team from Microsoft, a major investor in the AI firm, had uncovered groups linked to China, Iran, North Korea and Russia, the company said.

In a busy week for the firm, it also unveiled plans to give ChatGPT a better memory so that it could remember more of its users’ chats.

Dr Andrew Rogoyski, from the University of Surrey’s Institute for People-Centred AI, said he was encouraged by OpenAI’s safety approach to Sora, but questioned what access AI safety institutes had had to the tool ahead of its announcement.

“OpenAI has recognised the potential for harm with such a system,” he said.

“The idea that an AI can create a hyper-realistic video of, say, a politician doing something untoward should ring alarm bells as we enter into the most election-heavy year in human history, with over 60 democratic elections in 2024 and half the planet’s population voting.

“Interestingly, OpenAI plans to watermark Sora’s outputs with C2PA, a digital certification system that is growing in popularity as a means to track the provenance of information.

“Although OpenAI is promising further details on the safety measures put in place for Sora, one has to ask whether the UK’s AI Safety Institute, announced by Rishi Sunak last November at Bletchley Park and enjoying a commitment from the big AI firms to share their breakthroughs, has actually seen sight of Sora before its release yesterday.”

But Dr Rogoyski also acknowledged the potential of Sora, calling it a “major step forward” for AI video.

He said: “OpenAI’s Sora system potentially marks a ChatGPT moment for video.

“In the same way that the text-based ChatGPT launched just over a year ago has transformed and disrupted text-based work, from scriptwriting to email marketing, the Sora system could do the same for video.

“With a simple text-based prompt, Sora will create a video sequence with astonishing realism and clarity.

“If OpenAI’s showreel is to be believed – there have been examples of AI companies faking their own systems’ outputs – then this is a major step forward.”

By Press Association

More Technology News

See more More Technology News

National Cyber Security Centre launch

National Cyber Security Centre names Richard Horne as new chief executive

The lights on the front panel of a broadband internet router, London.

Virgin Media remains most complained about broadband and landline provider

A person using a laptop

£14,000 being lost to investment scams on average, says Barclays

Europe Digital Rules

Meta unveils latest AI model as chatbot competition intensifies

AI technology

Younger children increasingly online and unsupervised, Ofcom says

Migrant Channel crossing incidents

Ministers will be told to use AI to screen migrants for threats, adviser says

Nothing smartphone

UK tech firm Nothing to integrate ChatGPT into its devices

The Google offices in Six Pancras Square, London

Google confirms more job cuts as part of company reorganisation

Person using laptop

Housing association reprimanded after residents’ data compromised

A screengrab of an arrest in connection with the LabHost website

Arrests made and thousands of victims contacted after scammer site taken offline

Social media apps on a smartphone

Three-quarters of public fear misinformation will affect UK elections – report

Businessman racing with a robot

TUC calls for AI to be regulated in the workplace

The ChatGPT website

AI chatbot ‘could be better at assessing eye problems than medics’

FastRig wingsail launch

Scottish-made wingsail set for sea tests after launch on land

Immigration

Rollout of eVisas begins as Government aims for digital immigration by 2025

Elon Musk in 2024

X may start charging new users to post, says Elon Musk