Technology to transfer perfectly the movements of dancers to another person at AI, everyone to Michael Jackson

With the advent of the technology " fake porn " that transforms the face of a porn actress into the face of a favorite actor, the awesome power of Deepfake (deep fake), a video conversion technology using deep learning, is now known . New technology using deep fake technology to perfectly read dancer's movement and transfer motion to another person's model is emerging.

[1808.07371] Everybody Dance Now
https://arxiv.org/abs/1808.07371

Deepfakes for dancing: you can now use AI to fake those dance moves you always wanted - The Verge
https://www.theverge.com/2018/8/26/17778792/deepfakes-video-dancing-ai-synthesis

You can understand what "transfering movement of dancers" is by seeing the following movie in a single shot.

Everybody Dance Now - YouTube


It is the professional dancer that is the source of the "movement" to be transferred

Movement of a dancer can be transferred as a movement of an arbitrary target.

First, the movement of the dancer is filmed, and the program using deep learning converts the movement to the form of a stick figure.

After that, the movement of the stick figures is changed to the target and the image "Target dances" is output.

Dancer movement information can be "transplanted" to any target. Therefore, perfect synchronization can be realized by moving the movement to multiple targets.

Naturally, the source target can be ballerina as well.

Without knowing the ballet, it is possible to demonstrate perfect performance.

Successfully transplanted the movement by deep fake is a research team of Dr. Alexei Ephros of the University of California, Berkeley. By adding a dedicated neural network for realizing re-tracing of the face of the target and adding a subroutine to smooth the motion of the stick and to avoid jerking in order to reproduce natural dance, Is realized.

However, it is still impossible to accurately reproduce the clothes and the like that move by dancing, and the target is that it is necessary to wear garments that are perfect for the skin. As technology advances further, it seems possible to make every person including a fictitious character do a perfect dance.