Does a face tracking application using iPhone X's TrueDepth camera appear soon? A movie showing the trial and error of the developer is open
Everything is newly born changed "iPhone XOf particular interest is "TrueDepth camera" embedded in the top of the display. Face authentication that can only be used with iPhone X Although it is a TrueDepth camera that supports functions such as "Face ID" and "Anime character", developers trying to make use of this to other applications have appeared .
Developers are already using the iPhone X's TrueDepth camera for face capture apps - The Verge
https://www.theverge.com/2017/11/15/16658074/iphone-x-face-id-app-developers-3d-the-future
Moon Shine Dream ActionElisha Hung, a visual effects artist, performed motion capture of the face with iPhone X's "TrueDepth camera" and motion-captured using Xcode and Apple's new augmented reality (AR) framework "ARKit" We are releasing a movie that renders "3D movement" 3D.
iPhone X Face Motion Capture into Houdini (Projection mapping) on Vimeo
People projected in the upper left corner of the screen are iPhone X captured faces. What is displayed in the center of the screen is a 3D rendered image of the captured face.
Open your mouth wide ...
It has a subtle look with one eye closed ......
Even if you shake your face to the left or right, you can see that you can capture detailed changes in your face firmly.
Although it will change facial expression afterwards, things rendered 3D trace the facial expressions of the upper left corner of the screen firmly and show the high accuracy of the TrueDepth camera.
Also a movie that tracks the movement of the face with the iPhone X's TrueDepth camera. The movement of the face captured by 3DCG with polygon visible on the right of the screen is reproduced.
iPhone X Face Motion Capture into Houdini on Vimeo
Expressionless
Open your mouth ......
I will stretch under my nose.
I close my eyes ......
With only one eye open, various expressions are reproduced brilliantly. As the number of polygons of 3DCG increases, it seems that it is possible to reproduce a more detailed expression change.
In addition, game companies ·HatchlingsBrad Dwyer, the founder of the iPhone X, is also paying attention to the TrueDepth camera of iPhone X. We use RAW data that can be obtained from TrueDepth camera to create and publish a depth map of your face.
Here's another scan. Cleaned up a little. Probably a better representation of what it "sees"
- Brad Dwyer (@ braddwyer)November 15, 2017
I must note, this is one frame from the# TrueDepthcamera camera 0 closed camera 0 closed 0 closed camera closed 0 closed 0 closed camera closed 0 closed 0 closed 0 closed 0 closed 0pic.twitter.com/yweJ7hBJ1U
I am surprised that it is possible to track the movement of the face as accurately measuring the shape of the face with just the TrueDepth camera attached to the top of the iPhone X display. Apple has released "animation character" which can be used in message application as a function using TrueDepth camera, but after movie using this animation character is released by YouTuber immediately after iPhone X releaseFischer's-Fishers -It has been made public and has become a big topic on SNS such as Twitter.
I did not smile Ani characters got into the points. - YouTube
At the time of article creation, TrueDepth cameras can demonstrate the true value of only the face ID and anime characters, but as developers pay attention to TrueDepth cameras like Hung and Dwyer, animations born by motion capture of faces It may be that many other characters like characters will appear.
In some cases, ""Ani character" which can be used only on iPhone X works even on iPhone 8"Although it was reported that,Apple denies thisdoing.
Related Posts:
