A documentary movie showing the back side of the innovative 3DCG "14 model" production of Hatsune Miku is being released

Voice synthesis engine VOCALOID "Hatsune MikuWe manufacture and sellKrypton · Future · MediaIn order to fulfill a performance with a musician, I developed a unique 3DCG model Hatsune Miku "14 (Ichiyon) model". First document of a documentary movie that understands the back side of production of such Hatsune Miku "14 model"Technology edition"ButHatsune Miku channelIt is open to the public.

Krypton | Photographed with new technology of krypton development! "BUMP OF CHICKEN × Hatsune Miku" co-starred in PV
http://www.crypton.co.jp/cfm/news/2014/03/ray

【Hatsune Miku】 Hatsune Miku Documentary Technology Edition / 39ch Documentary: Technology 【Hatsune Miku】 - YouTube
)

Hatsune MikuBUMP OF CHICKENBy collaboration with, we are doing "real-time co-starter" with musicians for the first time in the world, not CG synthesis.


In order to enable real-time collaboration, the original 3D CG model developed by Krypton is Hatsune Miku "14 models".


We are developing new mechanisms such as screen material, sensor control, real-time animation technology and others.


The controller of the Hatsune Miku is used by the DTM equipment.


Singing and dancing Hatsune Miku fluffy and fluffy ... ...


I'm sliding the standing position of Hatsune Miku with the keyboard that originally plays the sound.


It is also possible to smooth movement by manipulating pitch bend.


Hatsune Miku can be moved in real time by controller ......


If you type in sequencer software, you can play the specified action.


Synchronization with the screen material and sensor attached to the camera to be shot is also performed by the controller.


Also, backups are multiplexed,MIDIWhenDMXIt is one of the features of Miku Hatsune "14 models" that the signal protocols are transmitted in parallel from the same master.


Sensors used in Hatsune Miku "14 models" are not produced from Ichi ... ...


Oculus RiftIt was made in parallel to wear it on the head like this and use it according to human movement.



In "14 model" it was a mechanism to shoot by rotating a cylindrical screen, so to use the sensor wirelessly with Wi-Fi.


Pull the rail around the screen, a camera for shooting in the camera dolly, and a person holding the sensor ride to adjust the angle information. As a result, when the correct position information of the camera is transmitted, the origin position of the CG is linked in real time.


Although a 6 axis sensor including 3 axis accelerometer and gyroscope is installed, gyro does not operate properly due to influence of studio magnetic noise ......


It covers with a human hand and guards the magnetism.


This system will be held in Beppu in 2013 "TRANS CITY FEAT.HATSUNE MIKUIt is based on.


In the production, 360 degrees of all the celestial picture was projected on the dome.


Also, on a large screen screenLive has been doneHatsune Miku, but because it is a music content called VOCALOID, it means that it is not a video signal but a sound master.


The screen "Ehatove Specification Screen Cylinder Version" used this time was originally developed by Krypton.


Isao Tomita of 2012 "Iha HaTove SymphonyIt is an evolutionary form of what was used in the back of the orchestra.


Looking at the screen from below it looks like this.


Distortion correction and color adjustment are done according to the curve.


Ultimately, he said that he aims to project Hatsune Miku without any screen.


For that, we need to create a light source that responds to particles in the air, but there are various theories that the theory is coming out. It may be possible to project as if Hatsune Miku existed in the future far away.


In addition, you can see the video that Hatano Miku "14 models" and BUMP OF CHICKEN "co-stars in real time" are from the following movies.

BUMP OF CHICKEN feat. HATSUNE MIKU "ray" - YouTube
)

Hatsune Miku and high touch.


Hatsune Miku to dance in the back. A band of light that flows throughout the cylindrical screen.


BUMP OF CHICKEN and Miku Hatsune sang in harmony, and it was a novel collaboration.