Google announces AI-based 'scam call detection' and 'YouTube video search' features
At the developer conference 'Google I/O 2024' held on May 14, 2024, Google announced that by more deeply integrating the AI model Gemini with Android, smartphones will be equipped with features such as video search, PDF summarization, and warnings against scams that pose as bank employees or other scammers and ask for personal information.
I/O 2024: New ways to experience Google AI on Android
https://blog.google/products/android/google-ai-android-update-io-2024/
At the launch event, Google announced the ability to display Gemini as an overlay on Android apps, as well as the implementation of multimodal functionality through an update to Android's built-in model, Gemini Nano.
First, Gemini will be able to appear on top of the apps you're using, allowing users to drag and drop AI-generated images directly into messages or Gmail, or tap 'Ask this video' to search for specific information in a YouTube video.
In addition, Gemini Advanced users will be able to use the new feature 'Ask this PDF,' which will provide an AI-powered summary of the PDF you're viewing, allowing you to understand the content without having to read every page. This update will be rolled out to hundreds of millions of Android devices over the next few months.
Gemini on @Android is becoming more helpful and context aware. Later this year, you'll be able to drag-and-drop generated images into Google Messages & Gmail, and ask questions about @YouTube videos and PDFs right on your device. #GoogleIO pic.twitter.com/ZRajfzXBWw
— Google (@Google) May 14, 2024
In addition, Android's built-in AI, Gemini Nano, will become fully multimodal, allowing the AI to understand a wider range of context in Android usage, including not only text input but also sights, sounds, and conversations. This update will be rolled out to Pixel series devices in the second half of 2024.
The multimodal nature of the Gemini Nano also enhances TalkBack , an accessibility feature that reads on-screen information aloud, allowing visually impaired users to receive richer information.
Later this year, @Android 's accessibility feature TalkBack will get a boost with Gemini Nano. Image descriptions will be clearer and richer, helping low-vision and blind users better navigate their phone with spoken feedback. #GoogleIO pic.twitter.com/qGWhJVbeRF
— Google (@Google) May 14, 2024
Global damage caused by fraud is increasing year by year, and a 2023 survey report compiling damage in 43 countries around the world estimated that damage caused by fraud, personal information theft, etc. is $1 trillion, or $260 billion, per year.
Google is using Gemini Nano to analyze conversation patterns commonly used in telephone scams, and is testing a feature that displays an alert if it detects requests for personal information such as passwords or PINs that real bank employees would never make, or instructions to transfer funds urgently or pay with gift cards. Since this function is all completed within the smartphone, the privacy of the call is maintained. More information about this opt-in feature is expected to be revealed in the second half of 2024.
Thanks to Gemini Nano, @Android will warn you in the middle of a call as soon as it detects suspicious activity, like being asked for your social security number and bank info. Stay tuned for more news in the coming months. #GoogleIO pic.twitter.com/wtc3rrk0Gc
— Google (@Google) May 14, 2024
Google says it plans to further integrate Gemini with Android to embed AI into every aspect of the smartphone user experience.
We're reimagining Android with AI at the core, enabling developers to build a whole new class of apps on mobile. With Gemini in Android Studio, you can take your development to the next level with coding help, a more helpful Crashlytics integration and more. #GoogleIO pic.twitter.com/SWFw9KGWet
— Google (@Google) May 14, 2024
Related Posts:
