Microsoft develops technology that makes it easy and highly accurate 3D scan with existing smartphone camera

A 3D model creation tool using Kinect sensor "Kinect Fusion"Microsoft has released a technology that enables easy and real-time 3D scanning with an existing smartphone camera"MobileFusionWe are working on the development of "

MobileFusion: Research project turns regular mobile phone into 3D scanner - Inside Microsoft Research - Site Home - TechNet Blogs
http://blogs.technet.com/b/inside_microsoft_research/archive/2015/08/24/3d-scans-with-mobile-phones-mobilefusion-research-project.aspx


In Microsoft's new research project, we are developing technologies that enable anyone to easily enjoy high-precision 3D scanning in real time easily, in the same way as ordinary mobile phone photography and movie shooting. "Thanks to the system under development, we will be able to easily get a full 3D image in the way of photography,Microsoft ResearchPeter Andondska, a student at the University of Oxford during internship.

The system developed by Ondrusska's research team is what is called "MobileFusion". I used a smartphoneExisting 3D scanning technologyCompared with "It does not need dedicated hardware" "It operates without Internet connection" It is said that it is excellent. In other words, not only does not need to purchase new and expensive hardware for 3D scanning, but also makes it unnecessary to carry dedicated hardware that becomes packages, and it will make it easier to enjoy 3D scanning even in places where radio waves can not reach That's it.

Charlam Izady, chief scientist of Microsoft Research and involved in the MobileFusion development project, said, "For example, take a picture of the Eiffel Tower visited on vacation with a tool like MobileFusion and share the 3D data you created with your family and friends It will be like that, "he says, and further insists that 3D scanning technology will be a new way of expressing pictures and movies.

The scanning accuracy of MobileFusion is very high, it is also possible to print data 3D and use it for Augmented reality games. You can see how much the 3D model actually created by scanning with MobileFusion is by seeing the following movie.

MobileFusion: Create 3D scans with your mobile phone - YouTube


The first thing to scan is people.


Scanning by holding the smartphone's camera.


It is scanned in the red frame of the cube.


Tap the screen to start scanning. It is a start when the green effect is dumbbed in the red frame projected on the screen of the smartphone.


Walk slowly around the subject with the camera of the smartphone and put it in the camera from every angle OK. The scan itself seems not to take so long



A 3D model completed by 3D scanning is a kore.


I did not wrap around behind the subject during the scan, so the back of the 3D model has become a cavity ... ...


As you can see from the front you can see that a highly accurate model like a photo is completed.


Then scan bear's stuffed animal. There are clamshells etc that are clumsy under the bears, but some of the leaflets have also been scanned.


Scanning thoroughly ......


The created 3D model is kore. This time it is completion of a beautiful 3D model no matter where you look from 360 degrees.




Besides busts ......



I am scanning lion statues and others. Although the accuracy itself seems like there is still room for improvement, I can fully understand that 3D scan can be easily enjoyed with existing smartphone.



Note that the upper left of the following image is a 3D model created by MobileFusion and the subject in the upper right is the subject photographed.


The upper left of the following image is a 3D model created with MobileFusion, the upper right isCVPR 20143D scanning with smartphone camera announced at(PDF)Similar technologyThe 3D model created by.


Mr. Izady, who is also participating in the project, and Push Meat Kohli, who is also the principal scientist of Microsoft Research and also involved in MobileFusion development projects, participated in the development of Kinect Fusion. Although Kinect Fusion developed by two people was a tool that made it easy to create 3D models, using PC and Kinect sensor is almost impossible to use on the go.

When Ondresca came to the research institute of Microsoft interns, Mr. Koli said that he would like to see the ease of use of the next level, and he seems to be starting to create a 3D scanning tool that can be used even on the go. What they focused on was "to ensure that most smartphones have enough performance to build a 3D scanning system", the "system of human eyes" to be 3D scanable with smartphone cameras We developed MobileFusion by creating an algorithm similar to MobileFusion.

It is scheduled to be held in early October 2015ISMAR 2015An announcement about MobileFusion is scheduled to be made and it is said that development has advanced to the stage of checking the operation on a smartphone of a different OS such as Windows Phone · Android terminal · iPhone.