Movie that artificial intelligence understands what kind of world you imagine if you read "Momotaro"



When people read books, I think that they often read through while imagining people, scenes, world view, etc. in their heads. Naturally, the information for inflating the image is largely due to knowledge gained in actual experience, such as seeing the real world and touching it. However,"Artificial intelligence"Does not have such premise knowledge from the beginning, but in order to be able to think like a person, it is necessary to teach information that artificial intelligence does not have. However, it is hard to grasp the gap between information of people and artificial intelligence. Therefore, we are developing VR applications and conducting technical research on artificial intelligence "VraiCreates a program to automatically generate a movie based on the contents of the text and publishes on YouTube what actually loaded "Momotaro". By seeing this movie you can know the world of artificial intelligence "Momotaro" and you can understand what information is missing.

Automatic video generation test from story text: Vrai Blog
http://blog.vrai.jp/article/455977263.html

Story video automatic generation sample "Momotaro" - YouTube


This scene that begins with a phrase familiar with "Long, long time, ...". "Grandpa" and "Grandmaster" are coming out, but only young looking grandmothers appeared.


In the scene where a big peach flows when the old lady is washing in the river ......


Peach will not come.


Was it responding to "Let's take it home", suddenly returns a scratch ......


Peach falls in the vicinity, the old woman extends her hand but does not reach it. It seems like "apple" instead of "peach" that fell, but there may not be other objects close to peach.


I will sing a song to the peach that is supposed to be flowing in the river originally, I can see that the scene that brings the peach near, because the peach is falling near, I can not express well.


With peaches in hand, the grandfather appeared in a scene saying "I will share with my grandfather earlier with my grandfather and eat it."


At home, when Grandfather and Grandma were looking at the peach, a baby who looked like a child appeared ... ...


I call it "Momotaro". Then, a young man's "Momotaro" appeared. Since the baby that should originally be "Momotaro" is intact, the characters will be four.


A scene where growing Momotaro knows the existence of "demons live" demon island ". "Demon" appeared for some reason. It seems that artificial intelligence has interpreted that "demon island" is not a noun, "" demon "is" island ".


In the scene where Momotaro wants to go to 'Onijima', 'Oni' that was in the vicinity moved to the island.


Tell them that "demons go to the island", and signs the word "go on" by the old man, Momotaro will also walk on foot and move to "demon island".


And his grandfather moved on foot on the "demon's island". In the previous sentence "There is a grandfather said," Because the grandfather is the subject, it was interpreted that "the old man goes to the distant" = "the old man goes to" the demon goes to the island " It may be the cause.


Momotaro and his grandfather had left and the old woman was left behind.


The scene switches to Momotaro ... ...


dog


monkey


Something like a ... ... will be your servant.


Find a ship ......


When Momotaro and the scene where "Sannon no Mago" of "dog" "monkey" "Kiji" gets on board the ship, a mysterious person gets on behalf of his servant. It seems that it interpreted as "get on" "dog" "monkey" "kiji" "servant" instead of "Sannon no miko" = "dog" "monkey" "hi" This seems to be a technically troublesome part in artificial intelligence development, and it is quite difficult to judge by artificial intelligence even if it can cover within the range of common sense by people.


The dog will ship the ship, but the dog waits on the spot because there is no clear sentence "Dog came aboard the ship ..."


Because the monkey sits on "Kaji", the hijo moves to the ship to stand in "HISASHI".



A soldier onigiri is watching on the island found a ship. I will rush in haste. In this case it was not judged as "a demon of a soldier", but it was judged as "a soldier with a demon", the model is a human soldier.


After Momotaro and Sannon's servant crawl into "the demon in the island" and hit the demon, we will return the treasure to the ship on board the ship.


However, the dog waits as usual. I will not ride a ship.


Mr. Momotaro, who was aboard the ship, suddenly moves to the house on foot, saying "Grandmother who is at home and an ogre on the island say" Momotaro is about to return ".


Then, the grandfather who is overjoyed "Oni island" and the old woman at home.



Lastly, "Dog" which has been waiting for a long time, "Monkey" and "Kiji" on the ship raises cries of joy and a great circle.




"Momotaro" imagined by artificial intelligence tends to be caught in chaotic contents from the person who knows the story, but what sort of information is missing, what sort of information the human being unconsciously supplements are concrete It is also becoming content to be understood. If we can fill up the missing part in the future, perhaps the future where artificial intelligence's imagination tells the story imagined by people perfectly is not so far.

in Software,   Video, Posted by darkhorse_log