During today’s GTC 2024 keynote, NVIDIA CEO Jensen Huang presented a groundbreaking AI NPC demo called Covert Protocol. This demo showcases the capabilities of Inworld AI, a major AI NPC platform that is specifically designed for game development. Inworld AI offers developers the tools they need to create immersive and realistic non-player characters (NPCs) within their games.
Unlike previous demos, such as Kairos, which used Convai technology, Covert Protocol leverages the power of Inworld AI. Inworld AI was originally introduced by modder ‘Bloc’ in popular games like Mount & Blade II: Bannerlord, The Elder Scrolls V: Skyrim, and Grand Theft Auto V. However, Rockstar Games quickly removed it from their games.
In November, Microsoft announced a partnership with Inworld AI to develop a comprehensive toolset that includes an AI design copilot and a character runtime engine. Now, through the integration of Inworld’s technology with NVIDIA ACE for Games, exciting new possibilities unfold.
NVIDIA ACE for Games, also known as Avatar Cloud Engine, is a platform that enables developers to create a complete ‘digital human pipeline.’ It begins with Riva, a tool that facilitates automatic speech recognition (ASR) and text-to-speech (TTS) using the customizable Nemotron large language model (LLM). With Riva, developers can shape unique character backstories and personalities that align with their game’s world. They can also program rules for NPCs through NeMo Guardrails, ensuring seamless and contextually appropriate interactions with players. Lastly, Audio2Face generates lifelike facial animation for game characters based solely on an audio source.
On the Inworld AI side, developers can fine-tune various parameters for each NPC, including personality, knowledge and cognition, goals, scenes, safety, long-term memory, and relationships. Kylan Gibbs, CEO of Inworld AI, emphasized that the combination of NVIDIA ACE microservices and the Inworld Engine empowers developers to create digital characters that drive dynamic narratives, revolutionizing how gamers interpret and engage with games.
One intriguing aspect is that NVIDIA envisions its ‘Digital Human Platform Partners’ taking ACE to market, catering to both game developers and enterprises seeking AI-driven customer service solutions. The current list of platform partners showcased at GTC 2024 includes Top Health Tech, Convai, Data Monsters, InWorld, Quantiphi, and Uneeq.
With this new AI NPC demo and the integration of Inworld AI technology with NVIDIA ACE for Games, the possibilities for immersive and engaging gaming experiences are expanded. Developers now have access to powerful tools that can bring their virtual worlds to life, fostering dynamic narratives and captivating player interactions.
FAQ
What is Inworld AI?
Inworld AI is a major AI NPC platform specifically designed for game development. It allows developers to create realistic non-player characters within their games, enhancing immersion and storytelling.
What is NVIDIA ACE for Games?
NVIDIA ACE for Games, also known as Avatar Cloud Engine, is a platform that provides a complete ‘digital human pipeline.’ It includes tools for automatic speech recognition, text-to-speech, character development, and facial animation, allowing developers to create lifelike and dynamic game characters.
How does the integration of Inworld AI and NVIDIA ACE benefit game developers?
The integration of Inworld AI and NVIDIA ACE for Games empowers game developers to create immersive and engaging gaming experiences. It offers them the tools to craft detailed NPC backstories, program realistic interactions between NPCs and players, and generate expressive facial animations. These capabilities revolutionize character development and storytelling within games.
Which companies are partnering with NVIDIA ACE for Games?
NVIDIA’s ‘Digital Human Platform Partners’ currently include Top Health Tech, Convai, Data Monsters, InWorld, Quantiphi, and Uneeq. These partners focus on different aspects of the gaming industry, including gaming NPC development and AI-driven customer service solutions.
Sources:
– NVIDIA GTC 2024 Keynote Presentation
During NVIDIA’s GTC 2024 keynote, CEO Jensen Huang introduced a groundbreaking AI NPC demo called Covert Protocol, which showcased the capabilities of Inworld AI. Inworld AI is a major AI NPC platform designed specifically for game development, allowing developers to create immersive and realistic non-player characters within their games.
Inworld AI was originally introduced by modder ‘Bloc’ in popular games like Mount & Blade II: Bannerlord, The Elder Scrolls V: Skyrim, and Grand Theft Auto V. However, Rockstar Games quickly removed it from their games. In November, Microsoft announced a partnership with Inworld AI to develop a comprehensive toolset that includes an AI design copilot and a character runtime engine.
The integration of Inworld AI technology with NVIDIA ACE for Games opens up exciting possibilities. NVIDIA ACE for Games, also known as Avatar Cloud Engine, is a platform that enables developers to create a complete ‘digital human pipeline.’ It includes tools such as Riva for automatic speech recognition and text-to-speech using the customizable Nemotron large language model. Developers can shape unique character backstories and personalities, program rules for NPCs, and generate lifelike facial animation based solely on an audio source.
On the Inworld AI side, developers have fine-tuning capabilities for parameters such as personality, knowledge and cognition, goals, scenes, safety, long-term memory, and relationships. This combination of NVIDIA ACE microservices and the Inworld Engine allows developers to create digital characters that drive dynamic narratives, revolutionizing how gamers interpret and engage with games.
NVIDIA envisions its ‘Digital Human Platform Partners’ taking ACE to market, catering to both game developers and enterprises seeking AI-driven customer service solutions. The current list of platform partners showcased at GTC 2024 includes Top Health Tech, Convai, Data Monsters, InWorld, Quantiphi, and Uneeq.
With the integration of Inworld AI technology with NVIDIA ACE for Games, developers now have access to powerful tools that can bring their virtual worlds to life, fostering dynamic narratives and captivating player interactions. This advancement in AI NPC technology opens up new possibilities for immersive and engaging gaming experiences.
Sources:
– NVIDIA GTC