Google's radar chip built-in gesture operation project "Project Soli" well understood movie

A movie that demonstrates how easy the project "Project Soli" for gesture manipulation corresponding to movement of hands that Google is developing, which could not be read by conventional sensors, is shown in an easy-to-understand movie It is open to the public.

Welcome to Project Soli - YouTube


The founder of the projectProject JacquardJust like Ivan Poupyrev.


"The hand is the ultimate input device," Poupyrev.


The hands are very accurate and can be moved very quickly and can be used very naturally when used.


Poupyrev wished that he wanted to catch that possibility and shape it.


For example, if you twist your fingers in a space without anything, you can set the time of your watch as if you are operating a crown ... ...


By changing the knob twisting, changing the volume.


In this project I shaped "Project Soli", radar was used for realization. Jaime Lien says, "Our team has focused on making radar a gesture sensor."


Radar sends radio waves to the target and receives radio waves that bounced back. This will detect where the object is located ... ...


What Poupyrev's team went through was to extract what gestures were done, using the rebound radar waves. For example, I closed my hands and opened up, and I examined that it would be such a wave.



"From the weird Doppler signal, we read the human intent," said Patrick Amifood, software director.


Emre Karagozler in charge of hardware says "Radar is very sensitive compared to camera, and it can read even small exercise," he says.


"I arrived at the idea of ​​recognizing the movements of hands that manipulate volume knobs and move sliders and manipulate virtual tools," says designer Carsten Schwesig.


For example, it is the operation of the volume to move the finger vertically in the vertical direction.


Using the index finger as the axis, moving the thumb sideways is the operation of the slider.


Move the thumb and index finger so that they are aligned with each other by pushing the button.


Move the thumb on a vertically oriented fist, and manipulate the virtual plane.


Hakim Raja, who is in charge of hardware, said that it increased processing power to realize these operations.


And built-in radar chip is completed.


A good place for radar is where you can use it while maintaining high accuracy without bare.


For example, built in smart watch, scrolling the map with just finger movement ... ....


Operate volume change, play / stop etc. without putting music player out of pocket ......


Even if you do not have a knob, you can also operate the radio just by moving your hand from a distance.


If it is built in the tablet, you can change the color depth ......


The size of the brush is not pinch operation, it is possible only by moving the finger.


In the keynote lecture, a demonstration was conducted using the real radar chip.

Google I / O 2015 - A little badass. Beautiful. Tech and human. Work and love. ATAP. - YouTube


Poupyrev was the one who entered.


When aiming at the realization of Project Soli, it was necessary to be able to read various hand movements, to be able to use even under the sun, and to be as small as can be built in smart watch.


Based on such conditions, it was not good with motion detection sensors and cameras, and that was the best radar.


The finished radar chip is this size.


When you rub your fingers on the device that contains the radar chip ......


The light blue dial on the screen moves in a dragged manner according to the movement.


Also, as with the movie I saw earlier, the time of the clock is moving around.


Poupyrev says that this Project Soli will be a source for creating something cool. Finally it seems that the era of manipulating without touching various things seems to be approaching.