"FlexSense" which can be operated as a physical layer by turning a transparent fluent sheet on a tablet

By placing a transparent and soft sheet with 16 sensors on a display such as a tablet, it can convert the display on the screen, it can be used as a physical layer such as Photoshop and 2.5D processing of the image will be possible , The new technology developed by Microsoft is "FlexSense"is.

FlexSense: A Transparent Self-Sensing Deformable Surface - Microsoft Research
http://research.microsoft.com/apps/video/default.aspx?id=230399

You can check from the following movie what is FlexSense.

FlexSense: A Transparent Self-Sensing Deformable Surface - YouTube


FlexSense is a sheet that does not require complicated equipment such as a camera and can change the display display to a different one just by putting it on an existing display such as a tablet. Aerial photographs are displayed in the following images ... ...


When I flickered FlexSense, a map that was not a picture appeared.


Of course you can also operate from the top of the seat. A red circle is attached to a part of the aerial photograph with a stylus.


It was properly displayed on the map.


Sheet can be turned from various directions.


So that is FlexSense. Piezoelectric sensors and silver conductors are used to generate voltage by applying pressure to 16 places of the main body.


The sheet is transparent and not only makes it clearly visible underneath, but it can be bent with guyagguya as it is soft.


This bend stretch is detected by sensors in 16 places. When lifting the right side of the seat, the seven sensors on the right side react.


When bending lifts up, the sensors on the top and bottom of the body react. I am finely aware of how bent it is.


Previous sensors could not accurately sense solids without a camera, but using Microsoft's newly developed algorithms, Microsoft enabled this.


In the development of FlexSense, Microsoft first shoots the shape of the sheet with a stereo camera and records information on the cube.


The green point on the image is the 3D tracked part, the red point does not bend.


I have derived two algorithms from here.


With FlexSense, it is possible to apply a filter effect to the screen. I thought that it was a monochrome photograph, and when I turned FlexSense color photographs spread.


You can also apply mosaic processing.


It can also be used as a physical layer when processing images in Photoshop.


The photo under processing is displayed on the display under FlexSense, so it can be processed while turning the sheet with flicker and sheet. You will be able to edit in 2.5D.


Other, enjoy crossword puzzles ......


Enjoy both images before and after processing.



In addition to just turning over, you can also make the meaning such as "move the image" to the action of turning the sheet.


Make a flip book.


By lifting FlexSense you can play cartoons and rewind,


A new game method which never existed is born.


You can also use the magic carpet on the screen by using it as a controller of the game.