Meta AI releases AI ``Animated Drawings'' that creates slimy moving animation from one character illustration for free
Meta AI's Fundamental AI Research (FAIR) team,
Animated drawings
https://sketch.metademolab.com/
First-of-its-kind open source project brings your animated drawings to life
https://developers.facebook.com/blog/post/2023/04/13/meta-os-animated-drawings/
A new, unique AI dataset for animating amateur drawings
https://ai.facebook.com/blog/ai-dataset-animating-kids-drawings/
FAIR Animated Drawings: Home
https://fairanimateddrawings.com/site/home
GitHub - facebookresearch/AnimatedDrawings: Code to accompany 'A Method for Animating Children's Drawings of the Human Figure'
https://github.com/facebookresearch/Animated Drawings
Animated Drawings is an animation project released by Meta AI's FAIR team that digitally processes hand-drawn illustrations into animations using object detection models, pose estimation models, and image processing-based segmentation. “We see the project as an opportunity to connect people and communities through creativity,” Meta said of his vision.
You can understand what kind of service Animated Drawings is by creating an animation from the demo that you can try in your browser. First, click 'Get Started' from the top of the site.
Next, upload an illustration of the character you want to animate. At this time, ``the limbs must not overlap the body,'' ``the drawing must be on white paper without wrinkles or tears,'' ``not too dark or shadowed,'' and ``personally identifiable information, unpleasant It is necessary to follow the rule that the content is not a picture that infringes on the copyright of others. You can also choose from the 'SAMPLE Drawings' prepared in advance, so select an illustration like a girl wearing a crown and click 'Next'.
Along with the message 'Do you agree to cooperate with Meta AI's research?' increase. You can see the detailed terms from ' ABOUT THIS DEMO '. Click 'Agree'.
Move the frame to confirm the range of the character. Animated drawings in the browser can only move one character, so if there are multiple characters in the drawing, trim it and specify only one character. When you can specify it, click 'Next' to proceed.
Next, you can make simple changes to the imported illustration, such as adding lines or erasing parts. After changing the picture, click 'Next'.
Finally, we will fix the positions of the parts in the uploaded illustration. You can move the circles connected by lines by dragging and dropping them, so adjust the positions of the center of the head, left and right ears and eyes, wrists, elbows, shoulders, hips, knees, and feet according to the illustration. After completing the settings and clicking 'Next', the illustration will be scanned for a few seconds.
Then, an animation was generated that skipped while spinning the arm.
You can see what kind of animation is created by watching the following movie.
At the time of article creation, there are 32 types of animation movements such as ``dance'', ``interesting movement'', ``jump'', and ``walking'', so you can make the uploaded character perform various movements by selecting animation. .
I tried to load
Finely set the position of parts.
As a result of creating animation, I was able to see that the movement of the legs was quite uncomfortable in the 'walking' animation, but the limbs moved cutely in the 'dancing' animation.
You can see the movies that actually made Hikaru Asahina animation of various movements from the following.
I tried dancing the character of the manga ``Anyway Ijimetai Asahina-san'' with Meta AI ``Animated Drawings''-YouTube
When I started developing Animated Drawings, there was no data set for learning the settings of the bounding box and joint positions for recognizing the specified range of the image, so I started the Animated Drawings Demo around 2021. , It seems that a model was created from the data uploaded by the person who experienced the demo, and it was accumulated as a data set with the user's permission. With over 1.6 million images uploaded in the first few months of the Animated Drawings Demo, many of which exceeded the specified rules, Meta realized that a more comprehensive tool was desired. I'm talking
Meta also said that through the Animated Drawings project, ``I hope that it will stimulate the new generation of creators and help with research that analyzes and understands human imagination from drawings.''
You can experience a demo of Animated Drawings in your browser, and you can also install it from GitHub . When installing and creating, various additional options are available, such as creating background transparent GIFs, moving multiple characters at the same time, and adding backgrounds separately from moving characters. You can see how to set each option from ' README.md ' on the GitHub page.
GitHub - facebookresearch/AnimatedDrawings: Code to accompany 'A Method for Animating Children's Drawings of the Human Figure'
https://github.com/facebookresearch/Animated Drawings
Related Posts:
in Software, Web Service, Video, Manga, Posted by log1e_dh