AR experience by the first smartphone "Lenovo PHAB 2 Pro" equipped with Google's space recognition technology "Tango" will look like this

Technological development of "AR (Artificial Reality)" is being advanced which creates a fictitious space by adding CG scenery to the real landscape. Among them, the well-known technology is a smartphone-based technology that enables Google to develop 3D space mapping in real time "Tango"It is a fabret with Qualcomm" Snapdragon 652 "optimized for Tango enabling AR experiences on smartphones"Lenovo PHAB2 Pro"Has been announced.

How Snapdragon processors support smartphone augmented reality experiences on Tango | Qualcomm
https://www.qualcomm.com/news/snapdragon/2016/06/28/how-snapdragon-processors-support-augmented-reality-tango-google

The following movie shows you what AR experience you can actually do with Tango and PHAB 2 Pro.

Snapdragon processors power the first Tango-enabled smartphone - YouTube


A state of measuring a dimension by drawing a line on the image of the room displayed on the screen of the smartphone. This is not an event on CG ... ...


Where augmented reality (AR) is displayed on the smartphone screen based on information actually acquired by multiple cameras and sensors. It is Tango's technology to enable such AR experience.


Scan the room indoors with camera and sensor, measure the actual furniture position three-dimensional ... ....


It is possible to arrange the furniture that is not supposed to exist in the trial.


Also, ordinary tables become fields of the game.


In this way, Tango can create a world that mixes reality and imagination by adding CG images on the real landscape.


The three major sensors that play a major role are the "depth sensor" which measures the distance between the "RGB camera" installed on the back of the smartphone and the object, and the "tracking camera" which uses the fisheye lens. Furthermore, realistic AR space is created by using gyro sensor and acceleration sensor built in smartphone together.


Simulating the placement of furniture in the room ......


I play dominoes by defeating Domino on the table. In both cases, the AR image by CG follows the real image in real, so the AR space without discomfort is reproduced.


In order to process information from many sensors in real time, it is necessary to execute huge calculations at high speed. As a result, it usually requires more than one coprocessor besides the CPU ... ...


Snapdragon integrates them into one SoC.


By collectively processing various information, it is compatible with high speed and power saving. In particular, it seems that Snapdragon 652 is becoming SoC optimized for Tango.


Snapdragon concerns data processingTime stampSucceeded to keep the period of 50 microseconds (0.00005 seconds) short.


By doing this, it is said that smooth operation which does not feel the time lag is possible.


Try putting the model of the chair you care about in your room ......


You can also keep fictional pets in smartphones.


The world's first Tango compatible terminal equipped with such Snapdragon 652 is Lenovo's Fabret with 6.4 inch display "Lenovo PHAB2 ProThat's why.


As mentioned earlier, Snapdragon 652 is an SoC optimized for Tango's operation, but in Qualcomm also Snapdragon 820, which is a high-end model, announces support for Tango as well. Furthermore, in the future it is planned to move forward with response to Tango through Snapdragon's 600s and 800s, so it seems that everyone will be able to experience AR in the near future.

· Additional notes 2016/10/06 10:15
It is revealed that "Lenovo PHAB 2 Pro" which becomes the world's first Tango compatible fabriclet will be released in November 2016. Oversee Google's VR and AR related effortsClay BavorMr. CNET announced the release date of Lenovo PHAB 2 Pro in response to the interview, the selling price seems to be from 499 dollars (about 50,000 yen).

Google's Tango phone, the Lenovo Phab 2 Pro, is coming in November - CNET
https://www.cnet.com/news/google-tango-lenovo-phab-2-pro-november/


Although the Japanese page of Lenovo PHAB 2 Pro has already been released, "The announcement and release in Japan is undecided" in Japan.

Lenovo Phab 2 Pro | The world's first Tango compatible smartphone | Lenovo Japan
http://shopap.lenovo.com/jp/tango/