Snap, the parent company of Snapchat, made exciting announcements at the Augmented World Expo. They showcased an early version of their real-time, on-device image diffusion model, which promises to deliver vivid augmented reality (AR) experiences. This model is designed to run on smartphones and can re-render frames in real-time, all guided by a text prompt. Snap co-founder and CTO Bobby Murphy emphasized the need for faster generative AI models to make a meaningful impact in AR.
Snapchat users can expect to see Lenses featuring this generative model in the coming months, while Snap plans to make it available to creators by the end of the year. Murphy expressed his enthusiasm for this new direction in AR, stating that it allows them to reimagine how they render and create AR experiences.
To further support AR creators, Snap introduced Lens Studio 5.0, which includes new generative AI tools. These tools aim to help developers create AR effects at a much faster pace than before, potentially saving weeks or even months of work. With this update, AR creators can generate highly-realistic ML face effects for selfie Lenses. They can also apply custom stylization effects to transform users’ faces, bodies, and surroundings in real-time. Furthermore, creators can easily generate 3D assets and incorporate them into their Lenses.
One of the standout features of Lens Studio 5.0 is the ability to generate characters like aliens or wizards using Face Mesh technology. AR creators can also quickly generate face masks, textures, and materials. To assist creators further, the latest version of Lens Studio includes an AI assistant capable of answering their questions.
These developments from Snap demonstrate their commitment to empowering AR creators and delivering immersive experiences to Snapchat users. By providing faster generative AI models and robust tools, Snap is enabling creators to unleash their creativity and bring their ideas to life more efficiently. As AR continues to gain popularity, Snap’s advancements in this field position them as a leader in the AR space. Users can look forward to more captivating and realistic AR experiences on Snapchat in the near future.