NVIDIA releases demo movie of 'NVIDIA Avatar Cloud Engine (ACE)' that allows you to talk to game NPCs with generated AI
On May 28, 2023, NVIDIA launched the NVIDIA Avatar Cloud Engine (ACE )” was announced.
NVIDIA ACE for Games Brings Virtual Characters to Life with Generative AI | NVIDIA Press Release
Watch this Nvidia demo and imagine actually speaking to AI game characters - The Verge
https://www.theverge.com/2023/5/28/23740908/nvidia-ace-demo-voice-ai-npc-game-characters
You can see how NVIDIA ACE is talking to the non-player character (NPC) of the game from the following.
NVIDIA ACE for Games Sparks Life Into Virtual Characters With Generative AI-YouTube
The demo movie is set in a cyberpunk ramen shop.
On the left is the NPC JIN, and on the right is the character KAI operated by the player.
It is said that the video that looks like the real thing was created using NVIDIA's 'RTX rendering technology'.
The player enters a ramen shop.
A player who talks to JIN, 'How are you?' What is noteworthy is that the player does not select pre-prepared lines, but inputs them by speaking their own voice.
'I'm sorry, but it's not very good,' was the natural response.
When the player asks 'Why?', JIN replies, 'I'm worried about crimes around here.'
When asked further, JIN said, 'I heard that the person who is causing chaos in the city is the crime lord Kumon Aoki. He is hanging out at an underground fighting club in the east of the city, so why don't you go there?' That's it,' and provided information that would be a hint for the next destination.
NVIDIA ACE used for conversation with NPC in the demo is 'NVIDIA NeMo' equipped with a large-scale language model that can learn NPC's background etc. Realize voice conversation by automatic speech recognition and text-to-speech. This is a middleware suite consisting of NVIDIA Riva, which allows you to play voices, and NVIDIA Omniverse Audio2Face, which allows you to change the facial expressions of characters naturally according to their vocalizations.
According to NVIDIA's announcement, NVIDIA ACE can be applied to multiple characters at once, so it is possible to have NPCs talk to each other.
'Generative AI has the potential to revolutionize the way players interact with game characters, dramatically increasing immersion in games,' said John Spitzer, vice president of development and performance technologies at NVIDIA. I talked to
Related Posts:
