Sony announces VR controller that can recognize finger movements with high accuracy
Sony Interactive Entertainment's Kazuyuki Arimatsu and Hideki Mori have developed a 'next-generation VR controller that can track each movement of fingers with high precision' and have released a prototype as a research result.
Evaluation of Machine Learning Techniques for Hand Pose Estimation on Handheld Device with Proximity Sensor | Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems
Watch Sony Show Research On Next-Gen Finger-Tracked VR Controllers
https://uploadvr.com/sony-next-gen-vr-controllers-finger-tracking/
You can see the performance of the next-generation VR controller that can track even the fine movement of the finger by watching the following movie.
Prototype PlayStation Next-Gen VR Controllers With Finger-Tracking!-YouTube
The new VR controller developed on the left side of the image is held in your hand. It has a shape in which a part like a pedestal is attached to the stick. On the right side of the image is a 3D image of the hand recognized by the controller.
When you squeeze the controller tightly, you can also grasp the 3D image. Almost no time lag is felt until the movement is reflected.
It can detect the action of bending one finger at a time and immediately reflect it in the 3D image.
It also senses subtle ways of opening your fingers, such as grasping your fist lightly.
Recognizes perfectly no matter which finger you bend or stretch.
Even with hands of different sizes, it is possible to recognize the following 11 types of movements.
The following is how you actually play a VR game using this controller. Building blocks in virtual space ...
It can be operated by pinching or lifting via the controller.
However, some finger movements cannot be recognized. The following is an example, and I can't recognize the action of 'sticking the index finger and middle finger, the ring finger and the little finger, and widening only between the middle finger and the ring finger'.
Similarly, the action of 'making a ring by sticking your index finger and thumb together' is also unrecognizable. When you look at the 3D image, you can see that you can recognize that you are bending your index finger, but not the area where it is attached to your thumb.
Also, this controller is a sweaty hand ...
It is said that even a hand with a ring or wrist watch will work without problems.
This controller has 62 electrodes inside as shown in the following figure, and it is a system that determines the movement of the finger from the capacitance sensed by each electrode, and the movement of the finger is tracked by the camera. Not. An optical tracking system and a
It is unclear whether this controller will be put into practical use at the stage when the paper is published. However, Sony acquired a license contract for haptics (skin sensation feedback) technology for VR controllers in May 2019, and the haptics technology for the PlayStation 5 controller ` ` DualSense '' is planned to be installed. , It is pointed out that the paper published this time may be the prototype of 'a controller for PlayStation VR2 equipped with haptics technology'.
Related Posts:
