Microsoft announces "Story Remix" which AI automatically performs professional-looking movie editing & processing, and it is possible to easily create a movie using 3D

Using Deep Learning & Artificial Intelligence (AI) technology, we automatically analyze the movie scene, identify the main character, automatically generate a movie optimized for each hero, or combine 3D objects like SF You can make movies easily, Absolutely animated movie generation application "Story Remix"Microsoft announced. Story Remix will be distributed at the same time as the next major update of Windows 10.

Introducing Story Remix in Windows 10 - YouTube


A father who follows a child while holding a baby.


It seems that we are filming our child's movie.


Activate the movie creation application "Story Remix" ... ...


I loaded the movie I shot.


Highlight scenes are automatically created and tagged & thumbnailed.


Dad making movies while caring for the two children.


After entering the movie title, tap "Remix" button.


The font has been changed.


"I can do it!"


The completed movie will be sent to a distant mother.


Write a letter ......


If you choose the mother's icon and share it ......


I was shared with my mother's terminal.


While staying at work, mom can immediately check the events at home.


On the other hand, my mom is shooting a dog taking a shower.


IPhone 7 Plus terminal used for shooting.


I took a slow motion movie on iPhone 7 Plus and imported it to Story Remix. Story Remix makes it easy to edit movies shot on iOS or Android devices.


Enter titles, sort photos and movies ......


FurthermoreGrooveIt is also possible to import BGM into the movie.


The created movie was posted to SNS in no time.


In Story Remix, "Windows 10 Creators UpdateIt is also possible to handle the 3D function added by ". "Remix 3D"Or"Paint 3D3D content such as movie editing can also be used.


You can edit downloaded 3D contents and use it.



Pasting 3D Tyrannosaurs in the movie ......


Change to a scene like a movie.


Take another scene running like running away ... ...


Combined with 3D tyrannosaurus.


Select the background and drag and drop it in the edit screen ......


A scene of escaping from Tyrannosaurus on the ancient earth is completed.


With Cloud Native Story Remix, it is also possible to edit the same movie at the same time by multiple people.


"I made it."


Everyone watches the completed movie using the tablet.


You can easily create images like SF movies.


Movie can be shared on SNS. I got "nice" from the person who saw the movie.


Story Remix is ​​not only professional with professional movie editing technology, it is easy for everyone to create a movie, it is a creator tool that stirs "creativity" that everyone has.


Story Remix which has the movie editing function like the above, the truly amazing is the automatic editing & processing function using the deep learning & AI function. The state of working with the automatic editing function is introduced in the presentation movie of Build 2017 below.

Microsoft debuts Windows Story Remix to edit and organize your photos and videos - YouTube


In Story Remix, the function to analyze and classify photos and movies registered in the library by image recognition function utilizing deep learning technology is installed.


For example, if you automatically edit a soccer movie with AI, the following things can be realized.


When we associate the character "See ya!" Written on the screen with Pen tool to a certain player ......


When the movie is played, letters follow around to follow this player.


In Story Remix, you can not only automatically detect movie highlight scenes, but also identify people who appear.


In addition, it is also possible to automatically edit a movie whose person is designated as "star (protagonist)" by designating one of the characters in the movie.


If you designate one player as a star, that player has been edited into a hero's movie.


It is also possible to let BGM choose AI.


If you select the music genre in Groove, you will choose the perfect BGM for your movie.


It is also possible to incorporate a rich 3D object of Remix 3D into a movie.


Select the fireball 3D object ... ....


Dragging and dropping in the movie ......


Completion of fire ball shoot. When I played the movie, the ball became a fireball and stuck in the goal net.




In addition, it is also possible to make explosive the ball that shook the goal net. Display 3D objects related to 'explosion' ...


After choosing one and dropping it into the movie just like before ... ...


The explosive fire ball shot ......


Exploded on the ground.


If you shoot the same event with more than one person, you can also make movies with abundantly integrated different cut scenes that changed the camera angle if you take those movies to Story Remix. Since AI automatically generates everything up to cut cut, it is possible to easily create elaborate movies made by professional editors.

Story Remix that allows you to edit movies using the AI ​​function is the next major update of Windows 10 as a free application "Fall Creators UpdateIt is scheduled to be installed in.