Ubisoft, a leading game development company, has recently unveiled its groundbreaking new technology called Neo NPCs. These player-facing generative AI-powered characters are set to revolutionize the gaming industry by allowing players to interact with non-player characters (NPCs) that possess distinct personalities and memories. The Neo NPCs are designed to respond to players in real-time, with unscripted dialogue, contextual awareness, and genuine emotions and animations.
The team at Ubisoft’s Paris Studio, with support from its production technology department, led the research and development of this innovative project. Unlike traditional NPCs, the Neo NPCs required detailed programming of their personalities, backstories, agendas, and emotions. As a result, every conversation with these characters is unique and tailored to players’ voice inputs and previous interactions.
The introduction of Neo NPCs has opened up new avenues for emergent gameplay. Ubisoft showcased this technology at a private event during the Game Developers Conference, demonstrating how players’ voice-to-chat inputs can drive unique and immersive gameplay experiences through conversations. The first part of the demo allowed players to introduce themselves to a Neo NPC and build relationships that can unlock new story elements and lore. The NPCs remember information shared by players, which can impact future gameplay. Ubisoft plans to use this feature to generate quests on the fly.
The second part of the demo showcased the context awareness of Neo NPCs. These characters can dynamically react to in-game events with unscripted responses, creating a more immersive world for players to explore. Quest providers, training partners, and companions can now adapt their behavior based on players’ actions.
In the final section of the demo, players were able to plan a heist with a Neo NPC. These advanced NPCs collaborate with players and offer alternative approaches and insights. This collaborative process adds a new layer of depth to gameplay, as players can engage in strategic decision-making with their Neo NPC counterparts.
Ubisoft collaborated with Inworld AI and Nvidia to bring the Neo NPCs to life. Inworld AI’s character engine and LLM technology were used to create complete backgrounds, knowledge bases, and conversation styles for the NPCs. Nvidia’s Audio2Face technology powered the real-time facial animations of these characters.
While there is no specific game in mind for the Neo NPCs yet, Ubisoft’s narrative-driven games like Assassin’s Creed, The Division, and Far Cry could greatly benefit from this conversation-driven gameplay. The possibilities for immersive worlds and emergent stories are vast.
The introduction of Neo NPCs represents a paradigm shift in the gaming industry. For the first time, players can have real conversations with NPCs that dynamically respond to their inputs. This technology enhances the player experience by making games more dynamic, immersive, and unique.
Guillemette Picard, SVP of production technology at Ubisoft, expressed her excitement about the potential of generative AI in transforming the way games are made and played. The true value of this technology lies in the creative opportunities it provides for both game developers and players.
Ubisoft’s Neo NPCs have garnered significant attention and excitement within the gaming industry. Players can look forward to a new era of interactive and engaging gameplay experiences, where their interactions with NPCs drive the narrative and shape the game world.
Source: GamesBeat