Sep 13, 2016 14:41:00

Succeeded in generating moving images from still images with artificial intelligence, but the result is a little gloomy part

A research team at the Massachusetts Institute of Technology (MIT) is developing artificial intelligence to generate moving images from still images by using algorithms based on machine learning using computers. The video that was actually generated has been released, but the result is quite 'interesting'.

Generating Videos with Scene Dynamics --MIT

http://www.cs.columbia.edu/~vondrick/tinyvideo/

Machine-Learning Algorithm Generates Videos From Stills | Popular Science
http://www.popsci.com/this-ai-generates-video-from-stills

At MIT, we first let the computer learn videos for each theme such as 'beach,' 'baby,' and 'golf swing,' and let them learn the movement patterns that often appear for each theme. Then, the still image is loaded and the video according to the theme is generated.

For example, this is a video generated with the theme of 'beach'. The waves are so natural that you can't think they were still images at first.


At the time of writing the article, it is said that the limit is to generate such a small size GIF animation.

The state of the beach where the setting sun sets is also quite reproducible.


However, some of them have strangely slimy movements ...


Some things are hard to understand what they are expressing.


In the case of 'golf', it looks like this. While there is a video that makes you feel like you are about to hit a putter ...


Some of the mysterious masses are moving.


'Train station' has the atmosphere of a train entering the station like this ...


For some reason, some trains are scattered.


There are some things that you might inadvertently say 'I'm sorry!'


When processing an image, it is said that it first recognizes 'people' and 'railroad tracks' that match the theme from the image. It seems that the process begins with understanding the situation using image recognition technology, which is being researched in the field of artificial intelligence.

You can check the videos that have been processed in this way from the links below, which are divided by theme. However, when you load each page, the amount of communication will be about 100MB, so you need to be careful when browsing, such as connecting to Wi-Fi.

・Beach

・Golf

・Train

・Hospital

・Unfiltered