NVIDIA releases AI chatbot 'ChatRTX' with added voice recognition and improved image search



NVIDIA has announced that it has added LLM support to its AI chatbot ChatRTX, improving image search functionality and adding voice recognition functionality.

Build a Custom LLM with ChatRTX | NVIDIA

https://www.nvidia.com/en-us/ai-on-rtx/chatrtx/



ChatRTX Adds New AI Models and Features | NVIDIA Blog

https://blogs.nvidia.com/blog/ai-decoded-chatrtx-update/

Nvidia's AI chatbot now supports Google's Gemma model, voice queries, and more - The Verge
https://www.theverge.com/2024/5/1/24146130/nvidia-chat-rtx-google-gemma-ai-model-features-updates

NVIDIA's On-Device AI Chatbot Now Supports Google Gemma and ChatGLM3
https://www.howtogeek.com/nvidias-chatrtx-adds-google-gemma-chatglm3/

'ChatRTX' is an update of 'Chat with RTX,' which NVIDIA announced in February 2024 as an AI chatbot that runs locally on Windows PCs using RTX series GPUs.

NVIDIA releases free chatbot AI 'Chat With RTX', which can run locally on PCs equipped with GeForce RTX GPUs - GIGAZINE



From the beginning, we have supported 'Mistral' and 'Llama2' as LLMs, but now we have added 'Gemma', 'ChatGLM3', and 'CLIP'.

CLIP is

an image recognition AI developed by OpenAI that enhances the image search capabilities of ChatRTX, allowing it to search local photo data without labeling. You can see how it works in the demo video.

ChatRTX Update: New Models & Features | Voice & Image Data Support - YouTube


Select 'CLIP' in LLM.



And then I selected the folder with the photos in it.



Enter 'Hiking in the mountain' at the prompt.



It will then show you three photos from the folder you selected that it thinks are related to mountain hiking photos.



You can also check other candidates. In this way, CLIP will search for images that seem to match the prompt, even if you don't label the photos you take with 'mountain' or 'hiking.'



In addition, the integration of the high-performance transcription AI 'Whisper' enables voice recognition and allows voice input in multiple languages for prompts.

ChatRTX is available for free from the NVIDIA official website. The file size is 30GB, and you will need an RTX30 or 40 series GPU with at least 8GB of VRAM to use it.

in Software,   Video, Posted by logc_nt