Movie to see how great the "Dynamic Virtual Display (Dynamic VR display)" used for directing red / white Perfume

In 2016Red and White Singing ContestThe red group's "PerfumeWhen I showed off the performance, on the stage "Dynamic VR Display (Dynamic VR display)The production was carried out using a technique called " This dynamic VR display was originally broadcast on September 19, 2016MUSIC STATION Ultra FESIt was developed for performance at, in that case was introduced as "optical illusion". We developed this with video technology realized by combining three technologies "motion capture", "real time 3D scan" and "viewpoint dependent graphic rendering based on camera tracking data"Rhizomatiks ResearchMasanori Manabe has released a movie that shows how the dynamic VR display is great on YouTube.

Dynamic VR Display (Rhizomatiks Research) - YouTube


Dynamic VR display developed for Perfume's performance


Two men riding on the glowing blocks displayed in the picture.


This is just standing on the image displayed on two huge screens, but from the perspective of the shooting camera I learn the illusion that two men have entered the digital data .



One of the technologies supporting dynamic VR display is "motion capture system". The data collected by the motion capture system is displayed on the PC screen.


The ground and the wall are reflected in the back, you can see that the image is being projected here.


Another technology supporting dynamic VR display is "real time 3D scanning system".


At the foot of a man standing in the middle of the stage is a shiny shadow of the same appearance as men.


When a man walks, the shining person also moves in the same way, just like a shadow made of digital data.


And the last third is 'Viewpoint dependent graphic rendering based on camera tracking data'.


From the following viewpoint, it is a collection of images output to the two men standing on the stage, the ground and the wall ......


When changing the viewpoint (right of the screen), the two men on the stage appear to be on the glowing cube. This is exactly "viewpoint dependent graphic rendering based on camera tracking data", that is, from a certain point of view it looks like two screens are one screen. In principle the picture is completed from a certain angleTrick artApplying the same illusion as the same as.


Looking from the correct angle (right) it looks like it is on the cube that shines, but from another angle (left) it looks just as it is on the image.


The glowing shadow is just a line from another angle.


It is particularly noticeable that the line of light moves from the back to the front ... ...


If you do not see it from the correct angle, the line of light turns crisply at the boundary of the two screens, and the three-dimensional feeling will not be felt even the dust.


A glowing scaffold ......


Mokomoko rises up just where the person is standing.


Two people standing on the glowing cube.


Dynamic VR display makes it possible to produce a look that seems to get lost in the digital world, which completes Perfume's masterpiece performance.