A demo video of Google's AI assistant 'Project Astra,' which understands video and audio and answers questions in real time, being used on smartphones and smart glasses is now available



In May 2024, Google announced

Project Astra, an AI assistant that can understand video and audio and answer questions in real time. In a new video released on December 11th local time, you can see people using Astra in all sorts of situations around town, including a Pixel smartphone with a test build of Astra and prototype smart glasses.

Project Astra | Exploring the future capabilities of a universal AI assistant - YouTube


Google's Project Astra waitlist signups begin with enhanced AR features | Android Central
https://www.androidcentral.com/gaming/virtual-reality/google-project-astra-ar-waitlist-opens-trusted-testers

Project Astra is a research prototype that explores the future capabilities of the universal AI assistant, and is powered by Gemini's latest model, Gemini 2.0 , which was just announced on December 11th.



In this video, the developer takes a Pixel smartphone equipped with a test build of Astra and uses it around the streets of London.



When the man arrived at the apartment, he said to Astra, 'I received an email with the apartment information. Can you tell me the door code and remember it?' Astra read the contents of the email and replied, 'I'll remember the door code for you. It's 1170.'



I entered the door code as instructed and the entrance door opened.



Astra can interpret and answer questions not only from your phone screen or the internet, but also from what your phone's camera sees. Show it a clothing tag and ask, 'According to these symbols, how should I wash this garment?' It will then give you instructions on how to wash it.



Also, when I showed him the control knob on the washing machine and asked him how to set it, he showed me how to set it according to the settings on the clothing tag.



If you ask about the various recommended tourist spots written on the notes, they will explain to you what each place is like.



The Astra also works well in the city.



When I asked about the correct pronunciation of 'scone,' they told me the common pronunciation.



If you show a mysterious sculpture you see around town and ask, 'Can you tell me about this sculpture?' it will tell you the name of the artist who created it and the title of the piece.



He also told us about the themes that artists explore.



Furthermore, while showing plants growing around the city, the man asked, 'Would this grow well if I planted it at home?' to which the man replied that the plant would adapt to the New York climate where he lives.



You can also show the screen of a friend's reading record app and ask for advice on what kind of book you would recommend as a gift to that friend.



You can also line up the spines of books and ask which one would make a perfect gift.



They answered my questions not only in English but also in French and

Tamil .



In addition, you can use Astra hands-free by wearing prototype smart glasses.



Check out today's weather



Asking about the park we passed



They can also tell you if there is a supermarket on your way home.



When I got back to my apartment, he gave me the door code from the first email without even looking at it, having dutifully followed instructions to remember it.



Google says it is having 'trusted testers' use Astra, and in a video posted by Google's Sundar Pichai on X, you can see the testers actually using Astra.



There is also a waitlist for the tester program open to the public.

Project Astra: Sign up for the Trusted Tester Program Waitlist
https://docs.google.com/forms/d/e/1FAIpQLScCrFFCFcZ9q_0Ti_a-qkh56W26lysgcArpNiaDDQ8DngG9eg/viewform

Related Posts:

in Mobile,   Software,   Web Service,   Video, Posted by log1h_ik