Is it possible for the Metaverse avatar to operate a real robot to eat buckwheat noodles?
An eccentric challenge video of an avatar in the Metaverse (virtual space) using the social VR platform
Eating soba from Metaverse-Nico Nico Douga
The challenger is Mr. Kuwamai , and Mr. Tamaki Amino is participating as a partner.
The upper left wipe is Mr. Amino's avatar in Metaverse on VRChat, and the right is Mr. Kuwamai in the real world. Mr. Amino operates a robot in the real world with a controller placed in the Metaverse, and it is a challenge to feed Mr. Kuwamai the soba noodles of Tanabe.
The power of the robot arm is not so strong, so there is no danger, but I wear goggles for safety.
The white cube held by Mr. Amino's avatar hits the controller, and if you move it up, down, left and right, the robot will move.
I'd like to lift the arm a little higher, but this is the limit because the avatar is short.
Succeeded in pulling the arm as it is and putting the soba in the soup.
At the end, Mr. Kuwamai lowered the position of his face ...
Succeeded in eating soba. It looks like you are picking up from your mouth, but you can see that the avatar is also doing his best to operate the robot.
'Shader that converts the object position and posture on VRChat into color and draws it on the screen' and 'Unity project that reads the drawn color and sends the object position to the robot arm' that were used in the challenge are released on GitHub. , Mr. Kuwamai himself explains the mechanism of operation on his blog.
Eat soba from the Metaverse-you can do it with Kuwamai
https://kuwamai.hatenablog.com/entry/2022/03/29/120000
Related Posts:
