A glove-type controller "Dexmo" which makes it possible to recognize the size and shape by touching objects in the game like reality

"HTC Vive", "PlayStation VR" and "Oculus Rift" each have a motion capture-compatible controller that tracks movement of hands. With these controllers, intuitive operations such as grasping objects by reproducing the movement of their hands in the virtual reality are possible, but in addition to reproducing the movement of each one of the fingers , A glove-type controller that enables a more realistic experience by communicating "touching sensation" to what was touched in the virtual reality "Dexmo"Has appeared.

Dexta Robotics
http://www.dextarobotics.com/

You can see how you actually use Dexmo from the following movies.

[2016] Dexmo: An exoskeleton for you to touch the digital world - YouTube


When Vive's controller pulls the trigger button, the "hand" in the virtual reality becomes goo, and releasing the button becomes par. This allows you to grab and throw objects in the virtual reality. Dexta Robotics further pursued the natural "feel" of virtual objects, and developed a glove type controller "Dexmo".


The exterior skeleton is carried in the glove, and it can recognize the shape and the size of the virtual object by transmitting the tactile feedback to the finger together with the motion capture.


If you move your finger with Dexmo attached, the movements of each finger are accurately reproduced in the game.


When you take a rock in the VR game, the exoskeleton pulls your finger outwards according to the size of the rock, so the range of motion of the finger is restricted along the shape of the rock. In reality, the same feeling that you can not hold a fist while holding a rock can be experienced even in virtual reality.


If you are a soft chick doll, force feedback will be sent so that you can tell that it is "soft thing" as paeonyeonpyeong.


If it is a rock, movement of the finger is perfectly restricted, but if it is a soft chick toy you can get a feeling like pinching it tightly.


There is also a controller "UnlimitedHand" that will come into contact with objects in the game, but UnlimitedHand is a mechanism to reproduce the "tactile" on the palm etc. by sending electric signals to the muscles. Although Dexmo can not obtain "tactile sensation", a different approach is taken that "shape" "size" etc. can be recognized by reproducing the "feeling touching things".

I have experienced the real tactile controller "UnlimitedHand" that comes into contact with objects in the game with CEATEC JAPAN 2015 - GIGAZINE


This is a pattern of test game using HTC Vive. Dexmo is equipped with Vive's hand controller, and in the game you can do operations such as dismantling the desk's legs and taking them in their hands.


Even if you hold the top of the desk with your right hand and hold the other with your left hand, feedback seems to be sent so that there is really a desk top plate in front of you.


Because it can reproduce the glove-type fine finger movement, it is possible to move difficult even with a Vive controller such as "Remove only the screw at the tip of the handle of the bicycle".


Dexmo plans to correspond to HTC Vive, VCR AR, MR device such as Oculus Rift · PlayStation VR · Hololens. It can be used for remote machine engineer training, remote control of medical equipment, games requiring new operations using educational applications and the characteristics of Dexmo. Dexmo appearing in the movie is the latest prototype under development and will be improved in the future. Improvement will be continued in the future.