Google announces "Lookout" application that will become an "eye" instead of the visually impaired and accurately convey the surrounding information

It seems that there are over 253 million people suffering from visual impairments around the world, so in order to allow people to live their daily life more safely and securely, Google detects the surrounding environment and the existence of objects An application that informs you and reads characters "LookoutWe announced.

Lookout: an app to help blind and visually impaired people learn about their surroundings
https://www.blog.google/topics/accessibility/lookout-app-help-blind-and-visually-impaired-people-learn-about-their-surroundings/

If you use Lookout, you need to install the terminal on which you installed the application by putting it in a strap that you lowered from the neck or in a shirt pocket. When you open the application and select the mode, Lookout will process the important items in the environment reflected by the camera. For example, in the case of the following places, there is an exit sign and we will inform you that there is a chair at the near foot by voice. Lookout seems to be designed so that users can use it with minimal instructions so that users can be crazy about their activities.


There are four modes, "Work & play" "Home" "Scan" "Experimental", in the application, "Home" when you are at home, "Scan" if you want me to read the text, When you go out "Work & play", you can use different modes depending on time and occasion. For example, "Home" will tell you the location of the sofa, table, dishwasher. The position is "the direction of the sofa is at 3 o'clock", it seems to accurately tell the direction from the front of the user in which direction. Because Lookout uses machine learning, the more users and the more users, the more accurate it will be to let you know what the user is asking for.


In addition, Lookout's core experience is handled within the terminal, so you can use the app without internet connection.

You can actually see how visually impaired people are using Lookout in the following movie.

Announcing the Lookout app - YouTube


"I was very excited by this new experience," said Maya Scott, who was born with a visual disorder. He is a person working as a lecturer in movies and art.


In front of such Scott's something like a pattern of something painted on the ground with a strap ... ...


People are walking in that.


"Because my field of vision looks like an Impressionist painting, I often hesitate to deal with everyday items, I can not find a pair of scissors," Scott said.


However, at the next moment, the machine voice announced "The scissors are at the 12 o'clock direction" and succeeded in safely taking ground scissors safely.


"Making a labyrinth as an artist and a teacher is the next step for me, because I can invite people and provide a physical experience through art is more than just observing It is from, "he said.


People walking around in front of us were walking in the maze that Scott who had visual impairment made with his own hands. It seems that Lookout helped when making this maze.


Mr. Scott with visual impairment perceives by listening with ears or smelling with a nose instead of actually seeing it.


After smelling the scent of lavender, when hitting the smartphone hanging on the chest with the concon, Lookout notified that "Lavender is in the direction of 12 o'clock." The appearance of Lookout makes it possible to obtain more detailed information on the surrounding environment than ever before and the daily activities of the visually impaired may become more diversified.


Lookout will be released in the second half of 2018.