Streamlabs announces 'Intelligent Streaming Assistant', a next-generation distribution support system that allows an AI assistant to read comments, create clips, and perform fully automatic production during distribution
Streamlabs, a provider of streaming and recording software, has announced the Intelligent Streaming Assistant , an AI assistant developed in collaboration with NVIDIA and
Introducing Streamlabs' New Intelligent Streaming Assistant in Collaboration with NVIDIA and Inworld AI | Streamlabs
https://streamlabs.com/content-hub/post/introducing-streamlabs-new-intelligent-streaming-assistant-in-collaboration-with-nvidia-and-inworld-ai
GeForce RTX 50 Series GPUs Double Creative Performance | NVIDIA Blog
https://blogs.nvidia.com/blog/generative-ai-studio-ces-geforce-rtx-50-series/
Streamlabs Launches Intelligent Streaming Assistant in Collaboration With NVIDIA and Inworld AI - YouTube
Intelligent Streaming Assistant has three main roles:
First, it acts as a virtual '3D sidekick'. This 3D sidekick understands the gameplay and the chat of the viewers and provides appropriate comments based on that. For example, when a particularly thrilling moment occurs in the game, it points it out to attract the viewer's attention, or when there is silence, it provides a topic to talk about, preventing the broadcast from becoming boring. It also keeps the broadcast exciting by highlighting the tipping and messages from the viewers in real time.
The second role is as a 'producer.' This automatically switches screens during streaming, inserts effects, creates gameplay clips, and more. The goal is to make streaming more attractive and dynamic by taking over tasks that would be tedious for a streamer to do alone.
Thirdly, the assistant will provide technical support. For example, it will help with setting up and troubleshooting streaming software, so that even first-time streamers can start streaming smoothly. This technical support is especially useful when complex settings are required or problems occur, providing streamers with an environment where they can continue streaming without stress.
The technical foundation of the Intelligent Streaming Assistant is NVIDIA's ACE (Avatar Cloud Engine) technology and the Inworld AI perception engine.
The main function of ACE technology is the generation of digital humans. It generates facial expressions and movements in real time, enabling natural dialogue. Next, animation generation from voice allows automatic generation of mouth movements and facial expressions in accordance with voice input. It also has a context understanding function that understands the situation in the game and the surrounding environment, and can respond appropriately based on that. And multimodal dialogue, which integrates and processes multiple inputs such as text, voice, and visual information, allows appropriate responses according to the situation.
NVIDIA is highlighting its Intelligent Streaming Assistant and ACE technologies as concrete examples of how generative AI and agent AI using NVIDIA RTX 50 Series GPUs can support real-world content creation.
Meanwhile, Inworld AI acts as a framework for agent AI, receiving various inputs such as voice, text, and images, and analyzing them in an integrated manner. It also has the concept of 'personality,' so it determines how to react based on the set character and behavioral tendencies. This allows you to select a personality that suits the streamer's streaming style. This allows Intelligent Streaming Assistant to respond flexibly to the atmosphere and tone of the stream. In addition, it also has a learning function, so it can improve more appropriate response methods from conversations with streamers and viewers' reactions, without deviating from the basic personality settings.
The Intelligent Streaming Assistant is scheduled to be released on the Streamlabs app store in the first half of 2025.
Related Posts:
in Software, Web Service, Video, Posted by log1i_yk