Pika, a rival AI video generator company, has announced the release of a new feature called Lip Sync, which allows users to add spoken dialog to their videos with AI-generated voices from ElevenLabs. This feature also includes matching animation to ensure that the characters’ mouths move in sync with the dialog. The new Lip Sync feature is currently in “early access” and is available to Pika Pro users or members of Pika’s “Super Collaborators” invitation-only program.
While Pika’s AI generated videos may be considered lower quality compared to competitors like OpenAI’s Sora or Runway, the addition of the Lip Sync feature puts Pika ahead in terms of disrupting traditional filmmaking software. This feature addresses one of the last remaining barriers to using AI for creating longer narrative films. Other leading AI video generators do not currently offer a similar feature natively, requiring users to rely on third-party tools and post-production additions.
In addition to Pika’s announcement, Runway has updated its Multi Motion Brush feature by introducing region detection. This update allows users to automatically highlight and select different objects in their videos for applying motion, without the need for manual painting. Pika also offers video editing capabilities and the ability to expand the canvas, although it currently lacks a similar granular motion control tool.
However, concerns have been raised about the training data used by AI video generator companies. Ed Newton-Rex, CEO and founder of Fairly Trained, a nonprofit organization dedicated to ensuring consent from creators and data holders for training AI models, questioned Pika about the data used to train its video model. This highlights the ongoing debate surrounding the ethics and consent involved in AI training data.
Despite these concerns, AI video generator companies continue to introduce new features and improve the quality of their video generations. This has led to an “arms race” between these companies, benefiting users of the technology but causing concerns within the professional filmmaking community. Filmmaker Tyler Perry, for example, expressed concerns about the potential job losses due to advancements in AI-generated videos.
As AI video generation technology continues to evolve, it is important to consider the ethical implications and ensure that consent and fair practices are prioritized. While these advancements offer exciting possibilities for content creators and filmmakers, it is crucial to strike a balance between innovation and responsible use of AI technology.
VentureBeat aims to provide a platform for technical decision-makers to stay informed about transformative enterprise technology and make informed decisions.