Local-first LLM 'Gemini Nano' that runs on a smartphone instead of on the cloud can now operate on Pixel 8 Pro, and will be introduced in advance to strengthen Gboard's Smart Reply and recorder's automatic summarization

Google announced the large-scale language model 'Gemini' on December 6, 2023. Furthermore, it was revealed that this Gemini will be introduced to the Pixel 8 Pro and will operate as a local AI running on the device rather than in the cloud.

Google Pixel December feature drop: New Gemini AI-powered updates

https://blog.google/products/pixel/pixel-feature-drop-december-2023/

Android Developers Blog: A New Foundation for AI on Android
https://android-developers.googleblog.com/2023/12/a-new-foundation-for-ai-on-android.html

A Present For Your Pixel | December '23 Feature Drop - YouTube


Google announced the next generation multimodal AI 'Gemini' on December 6, 2023. This Gemini is available in three sizes: Ultra, Pro, and Nano.

Multimodal AI ``Gemini'' with performance exceeding GPT-4, which can process text, voice, and images simultaneously and have more natural interactions than humans, will be released - GIGAZINE

'Gemini Nano, the most efficient model built for on-device tasks, will run on Pixel 8 Pro starting December 7, 2023,' said Brian Rakowski, Google's vice president of product management. Announced.

By installing Gemini Nano, the Pixel 8 Pro will be able to do the following from December 2023.

・Summary with recorder
With Gemini Nano, you will be able to instantly summarize the conversations recorded with the recorder app by transcribing them. This feature works on-device and can be used without a network connection. However, at the time of writing this article, only English is available.

・Smart Reply
'Smart Reply' is a function of the keyboard application 'Gboard' that uses AI to generate automatic reply texts in the messenger application. At the time of writing, it can be used with WhatsApp, and it will be available in more apps in 2024. However, at the time of writing the article, it is only available in English.

Furthermore, the Android development department has revealed ``Android AICore'' which allows access to pre-installed AI on the device. Android AICore enables fine-tuning with Gemini Nano's Low Rank Adaptation (LoRA), allowing you to use large-scale language models that are fine-tuned to suit your app's unique use case.

This Android AICore and Gemini Nano will be rolled out on Pixel 8 Pro, with more compatible devices expected to be announced in the coming months.