Facebook has open sourced a new technology 'Deep Focus' that can change the focus of VR images according to the line of sight
The technology 'Deep Focus' developed by
GitHub --facebookresearch / DeepFocus: DeepFocus: Learned Image Synthesis for Computational Displays
https://github.com/facebookresearch/DeepFocus
DeepFocus: Learned Image Synthesis for Computational Displays – Facebook Research
https://research.fb.com/publications/deepfocus-siggraph-asia-2018/
Introducing DeepFocus: The AI Rendering System Powering Half Dome | Oculus
https://www.oculus.com/blog/introducing-deepfocus-the-ai-rendering-system-powering-half-dome/
You can see what Deep Focus really is by watching the following movie.
DeepFocus Demo Video | Facebook Reality Labs --YouTube
The red cursor displayed on the screen indicates the player's gaze point read by the eye tracking function of the VR device.
When I look at the robot in the back, I can see the robot clearly, but the paper at hand is blurred ...
When I look at the paper at hand, I can see the paper clearly, but the scene in the back is blurred.
If you look back again, the paper at hand will be blurred. The focus speed is quite fast, and you can clearly see that the focal length is switched immediately after changing the line of sight.
DeepFocus has been developed using neural networks to optimize real-time blur rendering for a variety of VR footage. A generator to generate the dataset used to train DeepFocus is available on GitHub. This generator can randomly place objects of various colors and shapes in the VR space and generate a VR space for training DeepFocus neural networks, and you can see what it looks like by watching the following movie.
DeepFocus Random Scene Generator | Facebook Reality Labs --YouTube
Deep Focus is not the first to develop a technology that allows Oculus VR to change the focus of VR images, and at the Facebook technology conference ' F8 ' held in May 2018, the new variable focus head-mounted display ' Half Dome ' Has been announced.
Developed by Oculus VR's R & D center 'Facebook Reality Labs (FRL)', this Half Dome became a hot topic because it was equipped with 'Varifocal' that can change the focus of the image depending on what you are looking at. I did. Varifocal is a function that reads the wearer's gazing point and moves the lens and display in the headset back and forth. You can see how Varifocal works in the following movie.
Varifocal Actuation --YouTube
However, at Oculus Connect 5 held in September 2018, there was no announcement about Half Dome, and it was revealed that Brendan Iribe, CEO of Oculus VR, left Facebook at the same time, so Half It was also whispered that the development of Dome might have been discontinued.
With the advent of Varifocal and Deep Focus, for example, if you are looking at something near you, the scenery in the distance will be a little blurry, and if you are looking at something far away, the things near you will be blurred. It is thought that the immersive feeling in the VR space will increase above this.
A Facebook spokeswoman commented that the open source of Deep Focus was intended to accelerate the development of varifocal technology that would benefit the entire VR and AR industry. 'FRL's Display System Research (DSR) team continues to develop advanced display technologies, including Deep Focus, to explore the visual frontiers of VR and AR. Many prototypes, such as Half Dome, It's still being developed in FRL. '
Related Posts:
