OpenAI's New Text-to-Video Software Has People Shook

The new tool, which can generate photorealistic scenes with detailed prompts, is fueling fears about job security.

OpenAI logo displayed on a digital screen
Nikolas Kokovlis / NurPhoto via Getty Images
OpenAI logo displayed on a digital screen

OpenAI’s latest tool is both impressive and unsettling.

After finding success with ChatGPT, the research and development company shared a first look at Sora—a new text-to-video tool that remains in the beta phase. The GenAI model follows in the footsteps of other text-to-video engines from companies like Google and Runway; however, the quality of Sora-generated videos is unlike anything we’ve seen from OpenAI competitors.

According to the company, the tool uses a detailed prompt to create “complex scenes with multiple characters, specific types of motion, and accurate details of the subject and background. The model understands not only what the user has asked for in the prompt, but also how those things exist in the physical world.”

Introducing Sora, our text-to-video model.

Sora can create videos of up to 60 seconds featuring highly detailed scenes, complex camera motion, and multiple characters with vibrant emotions. https://t.co/7j2JN27M3W

Prompt: “Beautiful, snowy… pic.twitter.com/ruTEWn87vf

— OpenAI (@OpenAI) February 15, 2024
Twitter: @OpenAI

OpenAI shared several examples of Sora-generated videos, including photorealistic and animated clips that spanned up to 60 seconds long. Some of the highest-engaged videos showed wooly mammoths walking “treading through a snowy meadow”; a “short fluffy monster” examining a burning candle; and an outer space movie trailer shot on 35mm film. 

Prompt: “A movie trailer featuring the adventures of the 30 year old space man wearing a red wool knitted motorcycle helmet, blue sky, salt desert, cinematic style, shot on 35mm film, vivid colors.” pic.twitter.com/0JzpwPUGPB

— OpenAI (@OpenAI) February 15, 2024
Twitter: @OpenAI

Although the Sora-generated videos were quite grand, they fueled concerns about misinformation and AI’s impact on the job market—specifically in the realm of content creation. Many X users highlighted these concerns via X, wondering if the new tool would eliminate the need for production designers.

It’s so over I’m going to lose my job.

— Jonah 🎮 (@RealJonahBlake) February 15, 2024
Twitter: @RealJonahBlake

The entire stock footage industry just died with this one tweet. RIP pic.twitter.com/oGDp0Z0t9k

— Pledditor (@Pledditor) February 15, 2024
Twitter: @Pledditor

You're literally hurting jobs with this.

— Ben (@videotechuk_) February 15, 2024
Twitter: @videotechuk_

OpenAI just can’t stop killing startups

— Alex Reibman (@AlexReibman) February 15, 2024
Twitter: @AlexReibman

This is exactly what SAG-AFTRA was scared about

— Jay Scambler (@JayScambler) February 15, 2024
Twitter: @JayScambler

This is terrifying and going to steal jobs, not to mention the amount of terrible things this could be used for

— Blue 🌸 @ Raffle Soon (@bluefolf) February 15, 2024
Twitter: @bluefolf

OpenAI has not announced an official launch date for Sora. The tool is currently available to a small group of security experts who are testing it for vulnerabilities.

“We’ll be taking several important safety steps ahead of making Sora available in OpenAI’s products,” the company wrote. “We are working with red teamers — domain experts in areas like misinformation, hateful content, and bias — who will be adversarially testing the model…

“We’ll be engaging policymakers, educators and artists around the world to understand their concerns and to identify positive use cases for this new technology,” OpenAI continued. “Despite extensive research and testing, we cannot predict all of the beneficial ways people will use our technology, nor all the ways people will abuse it. That’s why we believe that learning from real-world use is a critical component of creating and releasing increasingly safe AI systems over time.”

Latest in Life