Review of 'Off Grid,' a free app that lets you run AI models locally on your smartphone; it can run both LLM and image generation models and is compatible with both iOS and Android.
Many AI development companies, such as Google, Meta, and Alibaba, have released some of their AI models for free, including several small models that run on smartphones. ' Off Grid ' is an app that allows you to download and run these small models on your smartphone, and it boasts a wide range of features, including text generation, image generation, image recognition, and tool usage. It seemed very useful, so I decided to try it out.
Off Grid - Private AI Chat - App on Google Play
Off Grid - Private AI Chat App - App Store
https://apps.apple.com/jp/app/off-grid-private-ai-chat/id6759299882
Off Grid is available for both Android and iOS. This time, we'll install and try Off Grid on an Android smartphone, the Pixel 10 Pro.
First, open the Off Grid distribution page on Google Play and tap 'Install'.
Once the installation is complete, tap 'Open'.
A tutorial will be displayed the first time you launch the application. Tap 'Next' to continue reading, or tap 'Skip' to skip it.
Next, the model download screen will appear. Each model has an estimated file size and RAM usage. Tap the download button for the model you want to use.
Once the download is complete, tap 'OK'. Please note that the model file size is several hundred MB, so we recommend downloading it via Wi-Fi rather than using a mobile data connection.
Once the download of the model you want to use is complete, tap 'Skip for Now' at the bottom of the screen.
This is the Off Grid home screen. This time, we want to start a chat, so we tap the area labeled 'TEXT' in the upper right corner to load the language model.
Once the list of downloaded models is displayed, tap the model you want to use. In this case, we tapped 'gemma-3-1b-it-GGUF'.
Once the model has finished loading, tap 'New Chat'.
This is the chat screen.
Enter text and send. This time, I entered the question, 'Should I put a screen protector on my smartphone?'
A response was displayed within seconds. It replied in English, 'We strongly recommend applying a screen protector.'
When I asked it to 'answer in Japanese,' it outputted the same content in Japanese. Using Off Grid, you can easily run various models like this.
Off Grid is developed as open source under the MIT License. The source code is available at the following link.
GitHub - alichherawalla/off-grid-mobile-ai: The Swiss Army Knife of Offline AI. Chat, Speak, and Generate Images - Privacy First, Zero Internet. Download an LLM and use it on your mobile device. No data ever leaves your phone. Supports text-to-text, vision, text-to-image · GitHub
https://github.com/alichherawalla/off-grid-mobile-ai
Related Posts:
in AI, Software, Smartphone, Review, Posted by log1o_hf