NVIDIA releases free chatbot AI 'Chat With RTX', can operate locally on PC equipped with GeForce RTX GPU
NVIDIA has released a free technology demo ' Chat with RTX ' that runs on GeForce RTX GPUs. Users can personalize Chat with RTX with their own content, and the system requirements are a Windows machine with an RTX 30 series or newer GPU with at least 8GB of VRAM.
Chat with RTX Now Free to Download | NVIDIA Blog
NVIDIA Brings Generative AI to Millions, With Tensor Core GPUs, LLMs, Tools for RTX PCs and Workstations | NVIDIA Newsroom
https://nvidianews.nvidia.com/news/generative-ai-rtx-pcs-and-workstations
Chat with RTX uses acceleration technologies from Retrieval-Augmented Generation (RAG) , TensorRT-LLM , and NVIDIA RTX to run generated AI locally on your Windows PC. Users can quickly and easily connect local files on their PCs as datasets to open source large-scale language models like Mistral and Llama 2 .
You can see how Chat with RTX works in the movie below.
Create A Personalized AI Chatbot with Chat With RTX - YouTube
There are two types of AI models that can be used with Chat with RTX: Mistral and Llama 2.
Files in local folders can be specified as datasets. In addition to text files, it also supports PDF and DOC formats.
When I asked Chat with RTX, ``What is the name of the restaurant that Sara recommended?'', it told me the name of the restaurant by referring to text files such as meeting logs in the dataset.
You can also specify YouTube URLs in your dataset. In the movie, the URL of NVIDIA's
When asked, 'What GPU did NVIDIA announce at CES 2024 ?', Chat with RTX answered from the video, 'NVIDIA announced the RTX 4080 Super, RTX 4070 Ti Super, and RTX 4070 Super.' .
By using Chat with RTX, you can use Chat with RTX to summarize the long minutes you have, or you can extract only the items you want to search from the content written in a PDF file.
Chat with RTX requires a GeForce RTX 30 series or newer GPU with at least 8GB of VRAM, an operating system of Windows 10/11, and an NVIDIA GPU driver version 551.52 or newer. At the time of article creation, it has not been released for Japan yet, and you can set a notification for the start of release from below.
Build a custom LLM using Chat With RTX | NVIDIA
https://www.nvidia.com/ja-jp/ai-on-rtx/chat-with-rtx-generative-ai/
Related Posts:
