Interactive art manipulating stuffed animals and projectors in real time with "Kinect"

Gesture recognition sensor released by Microsoft "KinectSince the work which used art for the art was exhibited at the Media Arts Festival at the Agency for Cultural Affairs, we have interviewed the situation that it is actually moving.

◆ "Monkey Business"By Ralph Kistler, Jan Sieber

"Monkey Business" chosen as a recruitment award is an art work that reads the movement of a person standing in front by a sensor and reproduces the stuffed monkey which contained the servo motor.

It is hanging from the wall like this.


It is not exactly attached to the wall, there is a little gap on the back side. Because a strong light is being applied, it is a directive that recalls the sinister existence lurking behind the movement of comical stuffed animals, with clear and shadow emerging behind.


In this way it is fixed with a solid iron bar.


Ralph Kistler, author of the demonstration, was born in Germany, is an artist living in Spain and he is good at satirical works.


Monkey stuffed animals that reproduce Mr. Ralph's movements as they are.


With this kind of feeling I do the same movement in near real time.


When the angle of the hand slightly changes compared to the above picture, you can see that the stuffed toy is reproduced properly.


The profile is like this.


Looking from the front in the moving place is as follows.




Read the movement of the person standing in front with the kinect installed on the stuffed animal.


Connect to "MacBook Air".


The connection with Kinect is a USB cable.


I recognized the movement of a person like this.


You can see how it actually moves in the following movie.

Movie of "Monkey Business" moving monkey stuffed animals with Kinect - YouTube


◆ "Soak"Yunsil Heo, Hyunwoo BangWork

"Soak" is a work that "reproduces the textile material virtually". It is an interactive art that a pure white cloth is colorfully dyed according to the movement of the hand caught by Kinect, and it has been selected as the recommendation committee recommended film.

Before people touch it just looks like a table.


The projector and Kinect are installed below.



The surface is made of resilient cloth, and it comes in color as the stain of the ink spreads as you touch it.


Since this stain is projected from the projector below, various colors will emerge in response to movement of the hand in real time.


Pushing a white place ... ....


The green spot spreads.


The actual working movie can be seen below.

Work movie of art work "Soak" using Kinect - YouTube


Exhibitions that can actually experience the fusion of technology and art with their own body will be held until March 4, 2012 "National Art Center, TokyoIf you are interested, please visit the venue.

© Ralph Kistler amd Jan Sieber
© Yunsil Heo and Hyunwoo Bang