AI ``HeadSculpt'' that can generate a 3D model of the head of a real person or anime character just by entering text



An AI ' HeadSculpt ' has been developed that can generate a 3D model of the head simply by entering text. HeadSculp can generate models with less discomfort than existing AI, supports anime and game characters, and has editing functions.

Head Sculpt

https://brandonhan.uk/HeadSculpt/

[2306.03038] HeadSculpt: Crafting 3D Head Avatars with Text
https://arxiv.org/abs/2306.03038

With HeadSculpt, you can generate a 3D model of the target simply by entering text (prompts) such as 'head of ○○' and 'portrait of ○○ taken with a single-lens reflex camera'. For example, the following is a 3D model generated by entering the prompt 'Portrait of Lionel Messi taken with a single lens reflex camera'. Click the image to see an animation of the 3D model rotating 360 degrees.



'Uzumaki Naruto's head' is like this. The forehead rest is a type of headband that covers the back of the head.



Game characters can also be generated, such as 'a portrait of Kratos appearing in

God of War taken with a single-lens reflex camera'.



'Portrait of Salvador Dali taken with a single-lens reflex camera'. The pin and stretched beard is impressive.



HeadSculpt makes it possible to generate a 3D model that does not feel strange even if it is rotated 360 degrees by learning the 'back of the head' in advance. It is also possible to edit the generated 3D model. An example of editing a 3D model is as follows.

First, the 3D model generated with the prompt ' Planet of the Apes: Caesar's head in Genesis ' is below.



If you edit the generated 3D model with the prompt 'Make wood carving', it will look like wood carving as follows.



Editing with the prompt 'be a swimmer with goggles' puts on goggles that look like swimming goggles.



The code used to develop HeadSculpt will be released soon on GitHub.

GitHub - BrandonHanx/HeadSculpt: [arXiv 2023 WIP] HeadSculpt: Crafting 3D Head Avatars with Text
https://github.com/Brandon Hanx/HeadSculpt



in Software, Posted by log1o_hf