I've heard digging roots and asked diggers about the amazing technology "Live2D" that can move illustrations as they are

In order to move a picture as an animation, it is necessary to create a 3D model to attach motion and to connect a number of pictures, but it is not possible to create a 2D model that moves from one picture to the original as it isLive2D"is. Such Live 2D announced new development "Live2D EuclidBy using this, "It is possible to illustrate illustration as a 3D model". Even though I heard it in words, it was hard to understand what kind of model would work with what kind of mechanism, so actually I got in touch with the head office of Live2D and showed the model creation process and I have been talking about various stories It was.

Live2D
http://www.live2d.com/

Live2D Euclid development announced | Live2D
http://www.live2d.com/news/euclid_development

◆ What is Live2D?
In the first place, Live2D is to create a 2D model from one original picture and express it by transforming it. The original image data that is the source of the Live2D model is OK with the illustration below.


If you actually use Live2D, you will be able to create the following animation from one illustration.

【Live2D】 Dropped time 【iPhone application】 - YouTube


If you want to create a Live2D model and create animation, you can use "Cubism Editor 2.0" which is released free of charge. "Cubism Editor 2.0" is a set of "Modeler" for creating a Live2D model from illustration and "Animator" for creating animation from Live2D model.

Download | Live2D


When actually creating a Live2D model, it is necessary to divide the part parts that you want to move the model as follows. For example, if you want to move a twin tail, you only need to divide the twin tail part into separate parts. However, in the process of part division, it is also possible to automatically process if parts to be moved are divided into layers.


For example, when you illustrate illustrations in Photoshop ......


If you divide each layer by layer as follows ... ...


When Illustration data is imported to the special software "Modeler" for creating the Live2D model, each part drawn separately for each layer is automaticallypolygonIt is possible to assign. In this way, each part to which polygons are assigned can be moved, so if you say "I want to move the created model finely!", It is OK if more parts are added.


For automatic processing, it is also possible to set detail of polygon fineness and so on.


In addition, looking at the parts to which polygons are assigned near, it is like this.


You can also transform an illustration like this if you twist a polygon.


Deformation information corresponding to arbitrary "movement" such as facial expression, pose, orientation, angle, etc. of each part is input, and the degree of the motion is quantified to the motion parameter of "Modeler". If you tweak parameters, you can adjust which parts move from where to where.


Depending on the number of parts and deformation information, the parameters may become extremely fine.


You can also see how the parts actually move on the spot. Winking ......


To make the eyebrows crisp ......


It is OK if you check the motion of the Live2D model while pulling out your mouth.


The Live2D model created in this manner becomes an animation if you attach a specific movement with "Animator". The range of motion of the model is limited to about 30 to 40 degrees to the left and right, but you can also add animation to Live2D model with Adobe After Effects or add hair shake by physical calculation by using auxiliary tool.

As for how much animation can be made with Live2D, Hatsune Miku appearing in the following movie is the one that moved the Live2D model, so if you do your best you can make something of the level below.

There is no formality in the song, but by doriko: Live2D_2014 - YouTube


◆ I heard stories at the headquarters of Live2D
I have heard stories about people who are actually developing from "Live 2 D" which can create 2D models from illustration to "Live 2 D Euclid" where development was newly announced.

The head office of Live2D is located in Shinjuku in Tokyo.


About Tomoya Nakagusu who is the representative director who taught various about Live2D.


GIGAZINE (hereinafter, G):
What kind of service did Live2D start from?

Tetsuya Nakagusu (middle,):
Originally I myself liked to draw pictures. I used 3D software when I was a student, but in the case of 3D I feel like kneading clay rather than "drawing a picture." It's fun, but unlike the approach of drawing a favorite picture, there was a sense that "this is not it". From that time on, I thought that it would be possible to glue the 2D picture as it is, and the idea of ​​Taisho was warming from that time.

Meanwhile, while 3D has evolved, there was a feeling that there is a sense of force for "approaching a two-dimensional picture to three-dimensional", or "I am not honest". Is not it an approach that is not natural becoming mainstream ...? In other words, there were things such as Flash which can only be moved in a plane, but I thought that there might be another way that is not such a thing.


G:
Rather than wanting to make the finished one closer to two dimensions, do you feel that you wanted to close the process you are making to the task of "drawing a picture"?

During:
I agree. Although I give up skillfully, I had a time when I wanted to become a cartoonist long ago. At that time, when I should use 3D as a creator, I thought that it would be okay if there could be a way to create a "three-dimensional idea that you can draw" Rather than making a model, it is best to be able to express things that are difficult to three-dimensionalize as a 3D model like "Sune's hairstyle" by three-dimensionalizing the paintings drawn simple That is why I thought.

G:
Live2D itself started from 2006, is not it?

During:
I agree.IPAThinks "Unexplored software creation project(Unexplored business) "There is something that gives subsidies to individuals, but while receiving such things, we have focused only on Live2D since our founding.

G:
"Live2D Euclid" announced this time will be able to create a more 3D model closer than the Live2D model made with Cubism now, right?

During:
Originally when moving a picture, there was anxiety that even if it could be moved to a certain extent with only a frontal picture, "I wonder if I could go 360 degrees". So, at first it started from moving the illustration, it has been 8 to 9 years since it was founded, but it finally became possible to start "360 degree turn".

At the moment there is no software called "Live2D Euclid", so it seems that it is time to reproduce the actual 360 degree stereoscopic expression on "Live2D Cubism". In Live2D Euclid, I will be able to rotate the illustration as it is created on Live2D Cubism 360 degrees. The trial model actually showed me is like this. The face was made using the technology of Live2D, and the body part was made with 3DCG.


When the same illustration is made into a 3D model, it becomes as follows and "The goodness of illustration is impaired", Nakagusu.


G:
It seems to be a hybrid "face of Live 2D model" and "body of 3D" now, will it finally become possible to move with 2D?

During:
There are various criteria, such as efficiency and stereoscopic correctness, but there are cases where it is better to use 3D and better to move with 2D. For example, rather than creating a Live2D model from a 2D illustration when making a running model, it would be easier for you to move things made in 3D. Furthermore, even in such a case, I think that there may be a pattern that emphasizes the efficiency of "creating face alone with Live2D and using the body with 3D body".

If you draw a picture normally and add some work to it, if Live2D becomes like that you can make a model that can be moved in three dimensions, it becomes interesting that you can move the model with the extension that draws the picture by the person drawing the picture I wonder if there is. I think that if Live2D can make the two choices equal, the two choices when creating animation such as "charm as picture" and "efficiency when moving" are created.

G:
Was the appearance of Live2D Euclid realized by technological progress? Or was there a lot of demand that "Can not create a 3D model with the illustration?"

During:
Perhaps, initially I did not think anyone could do something like Live2D. Although I was already able to move illustration in about two or three years since its establishment, there are not images of "how to use" such as "how to use" among customers, and at first it is very It was hard work. It gradually began to be used by Mr. Bandai, which is becoming "commonplace" now. There are few people thinking that "2D picture can be moved at full" all around the world, I think that such a person is trying to make such software. It seems like I can not think of driving an airplane in the age without planes, now we say "I can do this" and the reaction "I can do that!" Finally got back That is the situation.

G:
It is said that demand is rising, rather than being able to do, it is finally becoming echoed back to what it was able to do.

During:
I agree. Making two dimensions obedient is supposed to be a straightforward approach. Regardless of how 3D evolves, I think that it is also good for creators to develop 2D technologies and to become equal choices even 100 years ahead.

G:
It looks really different. I can not imagine what kind of technology it looks like a hand-drawn illustration like a 360 degree group. Is it possible to make a model that will be made with this Live2D Euclid from a single picture?

During:
I am not turning 360 degrees glue from one picture never and preparing some pictures. I think that there are cases in which it is possible to force 360 ​​degrees by force from the front picture. In order to move while enjoying pictures, it is good to prepare several pieces of "moving pictures in this range" and "pictures moving in different ranges" and switching them smoothly while overlapping to some extent When. This technology also has a patent.

In the case of Cubism, you can express about 30 degrees up, down, left, right, left, and right from one picture, but in the case of Euclid you usually need about 8 if you want to turn it grubly. If the model to be created is symmetric, it may be enough for about 5, but it may be more necessary if you adjust the top and bottom and left and right. Since the back appearance is rarely necessary, if it is a minimum model it is a couple of. After that you need it as necessary.

Euclid seems to make a model that can do 360 degrees by doing the work of "making one Live2D model from one picture" so far in eight directions. Although it may seem very simple when it is confirmed, it is surprising as it completes a model that can turn 360 degrees as "hand-painted illustrations".


Also, even if you try to adjust the model for each direction, there are 8 models so it will be possible to prevent other angles from being affected. In the case of 3DCG "If you want to snap a nose when looking at from this angle," it is said that your nose will be tough at other angles, but if you are Live2D, finish it to the best look for each angle You can do it.


During:
By the way, when thinking that Live2D is "aiming for Japan's first global standard", it is one of the three ideas that came up as candidates. So much Japanese software does not have that kind of thing.

G:
Certainly this is an idea that is likely to come only from Japanese people.

During:
It's frustrating if you leave from outside of Japan and become mainstream.

G:
What else was listed as a candidate?

During:
It is related to the web. There were various merits such as being able to turn web related people faster. However, Live2D decided to concentrate as a result, thinking that it would be unnecessary if the work using Live2D became famous, with the idea that no one seems to be able to handle anything.

G:
Deployment to the game is done, but is there no expansion to animation? I feel that if there are several original images I can make animation.

During:
Although Cubism can be used for animation production at the individual level, since movement is absolutely restricted in any way, in TV animation which must be moved freely something like "I can only use here but can not use other than here" There was bad usability and I was not able to use it quite easily. However, in the case of Euclid it will be able to move in all directions, so we have received inquiries from animation associations that have not had much reaction so far.

G:
Even if animation continues to use 3D more and more, I hear the opinion that "after all I can not accept 3D".

During:
Even what is said to be full 3D, there are places where the animator is modifying. 3DCG is approaching completion, is it still obedient? I think that there is a place where animator 's technology is not utilized as it is because animator' s skill and skill of modeling person must be mixed with each other. In the case of 3D, I can not let the skill of the person who draws the drawing be made full use, but it is not that the person drawing a picture with 3D development does not need it more and more, it seems to push 3D back like the skills of those people grow I hope we can get there. As a personal ideal,Takehiko InoueThe teacher'sVagabondI think that if you become a technology that can be used when animating movie, it is aimed at that.

G:
Certainly like Live2D Euclid prototype model, if the face is Live 2D and the body becomes 3D, it is a win win for both animator and modeler.

During:
Until now, when trying to move animation and illustrations into a stereoscopic model, even though creators work hard, there was something completely different from the original. There was also a case where the original author and the creator mutually agreed with it and did it as "It is OK with this", occasionally becoming "bad". I think that the user was also feeling that "it is slightly different, but it works well in 3D". Although the package is a beautiful illustration, the contents are 3DCG somewhat different ... something. If it uses Live 2 D, it can be made "it is natural to move in full with the illustration of the package".


During:
Currently I am not using Live2D Euclid's exclusive software, so parts that should not be visible are out there. In order to test whether it can actually be expressed, I forcibly make data on Cubism and I am trying to create a new drawing engine only and try it. At first, I was trying to draw points by handwriting on a grid paper, trying to take out a numerical value by myself and trying to move, so it is not exclusive but I am saving as much as there are tools that I can try.

The model of Live2D moves deformed finely divided parts, but in the case of Live2D Euclid it is possible to display 360 degrees by combining this for 8 or 10. So, if you do not compress this well it will not work on games for smartphones and so on.


During:
Now it's time to test "what you can actually do" so it's going to be something like this, but in future we will add a function of Live2D in a tool like Photoshop, "drawing a picture" Or I'd like to make it possible to create a Live2D model "while turning the model." Indeed, there are absolutely more people who like to draw pictures than to create 3D models, so I want to make such models enjoyable while making models.

The appearance of trying the 360 ​​degree turn of the prototype model actually made using the technology of Live 2 D is as follows. While in the movie you can see the moment when the face of the model switches, but when creating with Live2D Euclid, this "switching moment" seamlessly connects, making it possible to create a "hand-drawn illustration" model from any angle It is said that it will become.

Making a 3D model from illustration with "Live2D Euclid" will be like this - YouTube


As an advantage of making a model with Live2D instead of a 3D model, it was mentioned as "The best one can be made from any angle with a single model".


Also, in the case of the 3D model, when drawing a line on the nose, a beautiful nose bridge passes when viewing from the front, but if you change the angle, a line will enter an unnatural position. However, with Live2D, you can use the line of the original picture as it is and you can adjust the model individually with each angle, so you can make a natural and beautiful model from any angle.


G:
Does it feel like there is not so much difference between Cubism which is currently open and Live2D Euclid which was announced development?

During:
I agree. I am planning to add more functions to make it more efficient and I think that from about 2.0 we will be able to create models while drawing pictures.

G:
Is it that people who used Cubism will be able to use it without feeling uncomfortable?

During:
I agree. Because the basic principle does not change at all.

G:
As a model made with Live2D Euclid, can it be applied to things other than characters?

During:
The background can be used if OK if you can move the background with high quality to some extent. I think that 'Live2D' that moves pictures rather than 3D can make the best use of 'hand-drawn culture' technology. 3D is more suitable for expressing reality as it is, but if you make good use of the picture, it may be Live 2D that can make use of the original picture as it is.

G:
When will you release Live2D Euclid?

During:
I would like to release the beta version of Live2D Euclid by the middle of this year. I think that it is about 50 to 60 points that I am working on CUbism now, and in beta version I want to finish this to about 70 to 80 points of quality.

G:
May I ask you about the size and organizational structure of Live2D Co., Ltd.?

During:
Currently it is around 20 people, half of the development and creators. The creator makes model contracting and sample model creation, and the development is making the tool. I am conscious that by setting up a unit to make a tool and a unit to use, I do not actually miss the needs of the side that uses the tool.

G:
Although the story goes back a little, what is the most difficult point in the development of Live2D?

During:
There was no track record since we could not use it for the first time, but there was also a side that we could not use it because there was no achievement ... .... At that moment,Guy wearMr. Bandai Namco's "My sister can not be this cute" iP, but before I was going to sell it once, I use "I'll use one or eight" I got to get it. At that time, I made Cubism which moves the model with polygon at a rapid pitch.

Until then, there were many things like the flash animation in the world, and as for myself, there was much knowledge on the flash side. But, if you can not move it with polygons, there is something that you can not move with games, so we decided to make Cubism.


During:
At that time I was not able to use Live2D at all, there was only 1 person in the company, and I was developing it by one person. So now the chief designer told me that he would like to work on Live2D as a graphic and I feel that people gradually increased from there.

G:
Introduction results pageAs you can see, after "My sister can not be this cute" iP has been using Live2D for quite a lot of games.

During:
Especially because of the fast pitch of production of mobile games, thanks to that. Since the game became popular, it became the advertisement of Live2D.

G:
I see. Thank you for today.

After the interview, I made a prototype model of Live2D Euclid that can be rotated 360 degrees,Oculus RiftI had a valuable experience to watch with. When wearing the Oculus Rift and looking at the model, the character in front of me is indeed three-dimensional, but the face is a hand-drawn illustrative style, a very strange feeling. Even if the model moves violently or changing the viewing angle of the model, the appearance will not collapse, yet only the face remains hand-drawn illustration. When these technologies became widespread, I felt strongly that it would be easy for me to "see characters that appeared in comics and animation".