A technique is developed that allows you to create a 3D model of clothing from a single photo and dress-up simulation that matches your body shape

Researchers at the University of North Carolina at Chapel Hill developed technology to calculate the 3D model of the human body and clothes from the image of one person without motion and to change the clothes on 3D. With a new algorithm, it seems that not only superimposing images of clothes on images of the human body but also state changes of clothes due to wrinkles and body shape of clothes are also reproduced.

[1608.01250] Detailed Garment Recovery from a Single-View Image
https://arxiv.org/abs/1608.01250

Clothes Dressing You can see what you can do with the 3D model by seeing the following movie in one shot.

Physics-Inspired Garment Recovery from a Single-View Image


In the developed mechanism, it seems that the algorithm calculates based on the necessary data and outputs the final image.


The data required to create a 3D model is the image of the human being who wants to change clothes, the data about clothes to change, and the data on various human figures.


First of all, I analyze the input image of human beings, calculate body shape and features, and reconstruct clothes and body into 3D model.


By synthesizing the 3D data of clothes acquired from the input human image and the 3D model of the human body obtained from the image ... ...


Clothing and the human body are reconstructed into different 3D models and then reassembled once again.


The 3D model of the human body can be moved like an animation, and the 3D model of clothes also moves according to the movement of the human body.


For clothing, information such as the size of each cloth face, the part which is visible outside and the size of the part hidden inside is calculated, and by recalculating the garment model, it is possible to match the movement of the 3D model It is possible to change the state of clothes.


The left image is the original image input, the middle is the 3D model of the human body, the most right is the composite image of the human body model and the clothing model.


Even if the legs are almost hidden by long skirts, they will make up the human body model properly.


By reconstructing the human body and clothing into a 3D model, you can take a different pose from the original image.


You can enter the image facing forward and turn it backward with a 3D model ......


It is also possible to input images in a standing state and let them sit in a chair.


Even with a 3D model created from one image, it actually takes a lot of pictures from various directions and has a finish that is comparable to a movie composed of multiple image data.


You can also see that T-shirts that are easy to wrinkle on the sleeves and back can also be reproduced tightly.


A 3D model is constructed from a woman in the landscape ... ...


It is also possible to put on another clothes that is 3D modeled.


You can also reproduce the sway of the skirt by wind with animation.


This time, after acquiring the 3D model of the garment that a thin type woman is wearing ......


I got a somewhat blossoming female 3D model.


It is possible to reproduce it based on the 3D model as to how it will become when another person of the same clothes wears the same clothes.


A woman's skirt on the beach ... ...


I put on a different skirt.


You can make your clothes flutter in the wind according to the original image.


When you decide to purchase clothes by judging only images on the mail order site, you will inevitably become worried if you really feel worried about the size feeling or if you scratch more than you expected. If technology that can be tried on popularizes using 3D model of human body and clothes, such uneasiness seems to be in the past.