Qualcomm announces “Qualcomm AI Hub”, a generated AI library that operates locally on smartphones, “Snapdragon



Qualcomm has released ' Qualcomm AI Hub ', a collection of machine learning models optimized for local operation on smartphones, and ' Snapdragon X80 5G Modem-RF System ', a 5G communication system with a built-in AI processing processor, which uses AI to reduce consumption. We announced ' FastConnect 7900 ', a Wi-Fi 7 and Bluetooth communication chip that realizes communication with low power and low latency, at the mobile related trade show '

MWC '.

Qualcomm Continues to Bring the Generative AI Revolution to Devices and Empowers Developers with Qualcomm AI Hub | Qualcomm
https://www.qualcomm.com/news/releases/2024/02/qualcomm-continues-to-bring-the-generative-ai-revolution-to-devi

Qualcomm Unveils the World's Most Advanced 5G Modem-RF System, Harnessing Integrated AI to Enable the Next Generation of 5G | Qualcomm
https://www.qualcomm.com/news/releases/2024/02/qualcomm-unveils-the-world-s-most-advanced-5g-modem-rf-system--h

Qualcomm Redefines Connected Experiences with FastConnect 7900, the First AI-optimized Wi-Fi 7 System | Qualcomm
https://www.qualcomm.com/news/releases/2024/02/qualcomm-redefines-connected-experiences-with-fastconnect-7900--

◆Qualcomm AI Hub
High-performance processing chips are required to run AI such as chat AI and image generation AI, and it is difficult to run existing AI on smartphones. The machine learning models distributed on Qualcomm AI Hub are optimized to take full advantage of the hardware acceleration of the CPU, GPU, and NPU built into Snapdragon series SoCs, and developers can use Qualcomm AI Hub to You can download machine learning models and use them to develop AI apps for smartphones.

Qualcomm AI Hub can be accessed from the link below. At the time of article creation, more than 75 types of machine learning models have been distributed, including image generation AI 'Stable Diffusion', transcription AI 'Whisper', image recognition AI 'Clip', etc.

Home - Qualcomm® AI Hub
https://aihub.qualcomm.com/



Qualcomm also publishes operational examples of machine learning models distributed on Qualcomm AI Hub. In the movie below, you can see how the machine learning model ' LLaVA ', which can recognize images and answer questions, operates on a smartphone.

World's first large multimodal model (LMM) on an Android phone - YouTube


The demo movie below shows how to generate images using Stable Diffusion and LoRA on a smartphone.

Low rank adaptation (LoRA) on an Android phone - YouTube


The machine learning models distributed by Qualcomm AI Hub can operate not only on smartphones but also on PCs equipped with ' Snapdragon X Elite '. In the movie below, you can see how the ``large-scale language model that recognizes audio'' operates locally on a Windows PC.

World's first large multimodal model (LMM) with audio reasoning on a Windows PC - YouTube


Machine learning models optimized for Snapdragon can be downloaded not only from Qualcomm AI Hub but also from the GitHub repository and Hugging Face repository managed by Qualcomm.

GitHub - quic/ai-hub-models: Qualcomm® AI Hub Models is a collection of state-of-the-art machine learning models optimized for performance (latency, memory etc.) and ready to deploy on Qualcomm® devices.
https://github.com/quic/ai-hub-models



Qualcomm (Qualcomm)
https://huggingface.co/qualcomm



◆Snapdragon X80 5G Modem-RF System
The Snapdragon X80 5G Modem-RF System is a 5G communication system with a built-in 'AI tensor accelerator' for AI processing, which reduces power consumption and improves delay processing performance.



In addition, the Snapdragon X80 5G Modem-RF System uses AI to manage millimeter wave beamforming, and it is also possible to use a high-speed positioning system using AI. Details of the Snapdragon X80 5G Modem-RF System can be found at the link below.

Snapdragon X80 5G Modem-RF System | Qualcomm
https://www.qualcomm.com/products/technology/modems/snapdragon-x80-5g-modem-rf-system



◆FastConnect 7900
FastConnect 7900 is a wireless chip that supports Wi-Fi 7, Bluetooth, and ultra-wideband wireless communication (UWB). FastConnect 7900 uses AI to optimize Wi-Fi communication, reducing power consumption and reducing latency. It is also possible to improve the sound experience by combining Wi-Fi audio technology 'Qualcomm XPAN' and wireless audio technology ' Snapdragon Sound .'



Details of FastConnect 7900 can be found at the link below.

FastConnect 7900 | Qualcomm
https://www.qualcomm.com/products/technology/wi-fi/fastconnect/fastconnect-7900



in Mobile,   Software,   Hardware, Posted by log1o_hf