Viggle AI, a Canadian AI startup, has gained attention for its viral meme videos that remix footage of rapper Lil Yachty with various characters. The company has trained its 3D-video foundation model, JST-1, to have a “genuine understanding of physics.” Unlike other AI video models, Viggle allows users to specify the motion they want characters to take on, creating more realistic animations that abide by the laws of physics. CEO Hang Chu describes Viggle’s model as a new type of graphics engine built purely with neural networks.
Viggle’s AI model can create videos by uploading the original video and an image of the character users want to replace the original subject with. Alternatively, users can upload images of characters along with text prompts for animation instructions. The model can even create animated characters from scratch using only text prompts. While the model’s videos may not be perfect, with shaky footage and expressionless faces, it has proven effective as a visualization tool for creatives such as filmmakers, animators, and video game designers.
Currently, Viggle offers a free limited version of its AI model on Discord and its web app, along with a $9.99 subscription for increased capacity. The company is in talks with film and video game studios about licensing the technology, but it has also seen adoption among independent animators and content creators. To support its growth, Viggle recently raised a $19 million series A funding round led by Andreessen Horowitz.
Regarding training data, Viggle’s CEO initially stated that the company relied on publicly available data, including YouTube videos. However, a spokesperson later backtracked on this statement, stating that the CEO “spoke too soon” and could not disclose details of the training data. However, Viggle’s spokesperson eventually confirmed that the company does indeed train its AI models on YouTube videos, emphasizing that the training data is carefully curated and complies with all terms of service. This use of YouTube videos as training data is a common practice among AI model developers, although it is rarely acknowledged publicly.
Overall, Viggle AI’s AI video model offers a unique approach to generating realistic and controllable animations. With its growing adoption among creatives and plans for expansion, Viggle is poised to make a significant impact in the field of AI-generated video content.
