OpenAI’s Sora AI model has been making waves in the tech community and media world with its ability to create realistic, high-resolution videos. While the model is currently only available to a select few, some users have already started creating and publishing projects with it. One of the early access users, writer/director Paul Trillo, recently made what is being hailed as the “first official music video made with OpenAI’s Sora” for indie musician Washed Out.
Trillo had actually come up with the idea for the video ten years ago but never pursued it until now. The video consists of 55 separate clips generated by Sora out of a pool of 700, all stitched together in Adobe Premiere. Trillo shared his workflow on social media, revealing that he used only the model’s text-to-video capabilities without incorporating still images.
This example of the power of Sora demonstrates how AI can be used to create compelling media. It also serves as a counterpoint to recent revelations about another demo video called “Air Head,” which relied heavily on other VFX and video editing tools. The fact that some creatives are embracing AI tools despite criticism shows the ongoing desire for new ways to express themselves and tell stories.
While Sora is not yet available to the public, companies like Adobe are already looking to integrate it into their software. However, until that happens, users will have to generate AI video clips in third-party software before importing them into Premiere. This process is not as seamless as it could be, but it highlights the demand for AI-powered video creation.
In an interview with the Los Angeles Times, Washed Out expressed excitement about incorporating this new technology into his work. He sees it as a pioneering opportunity to explore new creative possibilities. The interview also revealed some of the specific prompts used for the video, showcasing the level of detail required to achieve the desired shots and movements.
Despite the enthusiasm from some creatives, there are concerns about the potential exploitation and copyright infringement associated with AI-generated content. Critics argue that AI models like Sora scrape and train on prior works without the informed consent or compensation of human artists. This ongoing debate highlights the need for responsible integration of AI in the creative industry.
Overall, the use of AI in video production is an exciting development that offers new possibilities for storytelling. While there are challenges to address, such as ethical considerations and workflow integration, the creative community continues to explore and experiment with AI tools. OpenAI’s Sora is just one example of how AI is reshaping the way we create and consume media.