Technologies will be developed to create 3D models that can run and jump from only one image

Speaking of "to produce 3D data from photographs", it is common to express the thickness and irregularities of the model by performing 3D modeling based on photographs taken from various angles of the model. In such a circumstance, the research team of the University of Washington developed "the technology to create a 3D model from only one photograph".

[1812.02246] Photo Wake-Up: 3D Character Animation from a Single Photo
https://arxiv.org/abs/1812.02246

Photo Wake-Up: 3D Character Animation from a Single Photo
https://grail.cs.washington.edu/projects/wakeup/

This Algorithm Can Create 3D Animations From A Single Still Image
https://futurism.com/algorithm-3d-animations-still-image

Research teams such as Chung-Yi Weng of University of Washington, Brian Curless and Ira Kemelmacher-Shlizerman belonging to Facebook, etc. generate 3D characters based on only one picture and painting, and can freely as animation We announced that we developed a technology " Photo Wake-Up " that can be moved.

This is the movie that explained the technology developed by the research team.

Photo Wake-Up: 3D Character Animation from a Single Photo


With the newly developed Photo Wake-Up technology, from just one photo ... ...

A 3D model of the basketball player was generated, started to run out of the picture and started running.

Also, even from paintings written on the wall ......

It is possible to move people by 3D modeling of people.

In addition, the main character of the popular manga · animation " Dragon Ball " · Son Goku ......

I was able to jump it into a 3D model.

Moreover, even Picasso 's representative painter of Cubism can be converted to 3D.

A woman drawn in cubism from the painting struck out and walked toward here.

Also, by applying Photo Wake-Up to AR (Augmented reality), it is also possible to create characters converted into 3D from the real world.

When a woman wearing a goggle points his finger to a painting ......

A woman who jumped out of painting started running.

The point to worry about here is how to create a 3D model from one picture.

In Photo Wake-Up, first prepare a photo ... ...

Identify the person in the photo and superimpose the deformable 3D model on the subject.

Then label each part of the body and map it.

Mesh created parts are made into 3D ... ...

Combine texture.

Then, the 3D model of the person can be separated from the background of the photo ... ...

The model jumped out of the picture.

The thickness and structure of the body has been firmly 3Dized, and I do not think it was produced from only one picture.

Whether you use Photo Wake-Up or not, black and white photos ... ...

You can freely 3D model a person who appears as a poster of a movie.

There was no problem whether it was a person expressed only by shadows.

It's a fun thing that is not graphic.

In addition to being able to create a 3D model of a person easily, it is possible to combine with AR technology to create a way to interact with new art.