NVIDIA ACE for Games

Written by Mohamed Fawzy

Mohamed is the founder of SALAMA PRODUCTIONS ©, an indie game developer and writer. He has a passion for creating episodic cinematic games that combine stunning graphics and captivating stories. His vision is to showcase the beauty and mystery of nature and reality. He believes that games are a powerful medium for expressing ideas, emotions, and messages that can inspire and entertain people around the world.



World News



0 Comments(s)



May 31, 2023

NVIDIA Kairos Demo Shows the Future of NPCs with Generative AI

NVIDIA has unveiled a stunning demo that showcases how generative AI can bring life and intelligence to virtual characters in games through NVIDIA ACE for games. The demo, called NVIDIA Kairos, features Jin, an NPC who runs a ramen shop and interacts with players using natural language and realistic facial expressions.

NVIDIA Kairos was created using NVIDIA Avatar Cloud Engine (ACE) for Games, a new service that allows developers to build and deploy customized speech, conversation, and animation AI models for NPCs. NVIDIA ACE for Games leverages NVIDIA’s expertise in AI and game development to provide optimized AI foundation models, such as:

NVIDIA NeMo, which enables developers to build and customize large language models that can reflect the character’s personality, backstory, and context. Developers can also use NeMo Guardrails to prevent counterproductive or unsafe conversations with NPCs.
NVIDIA Riva, which provides automatic speech recognition and text-to-speech features to enable live speech conversation with NPCs in any language.
NVIDIA Omniverse Audio2Face, which generates expressive facial animation for NPCs from just an audio source. Audio2Face supports Unreal Engine 5 and MetaHuman characters.

NVIDIA collaborated with Convai, an NVIDIA Inception startup that specializes in conversational AI for virtual worlds, to integrate NVIDIA ACE for Games modules into their platform. Convai’s platform enables developers to create and deploy AI characters in games and virtual worlds with ease.

“Generative AI has the potential to revolutionize the interactivity players can have with game characters and dramatically increase immersion in games,” said John Spitzer, vice president of developer and performance technology at NVIDIA. “Building on our expertise in AI and decades of experience working with game developers, NVIDIA is spearheading the use of generative AI in games.”

NVIDIA Kairos was rendered in Unreal Engine 5 using the latest ray-tracing features and NVIDIA DLSS. The demo was announced at COMPUTEX 2023, along with other innovations such as NV ACE for Games, Omniverse, and RTX. For more information, visit the NVIDIA website.