If you have an ultra-compact and ultra-lightweight mobile motion capture 'mocopi' and a smartphone, you can become a virtual beautiful girl anytime, anywhere



An ultra-compact and ultra-lightweight mobile motion capture ' mocopi ' that can easily track the movement of the whole body anywhere by linking with a smartphone such as an iPhone and move a 3DCG model avatar January 20, 2023 from Sony Appears in I got the opportunity to experience such a mocopi ahead of time, so I actually put mocopi on my whole body and moved the avatar to check its performance.

Mobile motion capture mocopi | Sony

https://www.sony.jp/mocopi/

You can see what mocopi looks like by reading the following article.

Sony's 'mocopi' photo review that can capture the movement of the whole body with ultra-compact & ultra-lightweight - GIGAZINE



The flow of setting up mocopi on a smartphone has been summarized in the following article. The setup itself is very easy, and full tracking is ready in just 30 minutes.

I tried setting up Sony's ultra-compact motion capture 'mocopi' that can easily perform full tracking anywhere with a smartphone - GIGAZINE



The mocopi official application used this time is a beta version that has been released in advance, and at the time of article creation, it is possible to record the movie of the avatar that moves according to the captured motion data and the motion data itself. It's easy to record movies in which avatars move, just tap the record button from the application.



A 3-second count is made and recording begins. The movie frame rate is 30 fps, and the motion data frame rate is 50 fps.



Below is a movie actually recorded with the mocopi application. Not only the position of the limbs, but also the twists of the wrists and ankles are reflected in the avatar. Not only the height of the neck, but also the angle and twist of the neck have been reproduced. Also, I tried some pretty intense movements such as jumping and jumping, but it was properly reflected in the avatar.

I tried full tracking where Sony's ultra-compact motion capture 'mocopi' was installed and the body was twisted, jumped and jumped - YouTube


Also, the following shows the movement of the avatar tracked on mocopi and the actual movement. There is almost no lag between the actual movement and the movement of the avatar on the iPhone, and the movement is smooth without sudden bending of the neck or limbs.

Where you are actually doing full tracking with Sony's ultra-compact motion capture 'mocopi' that can be used quickly with a smartphone - YouTube


At the time of article creation, you can also choose a simple humanoid avatar 'HUMAN' in addition to RAYNOS , the official mocopi avatar. To change your avatar, tap 'Avatar' in the upper left.



Tap 'HUMAN'.



HUMAN is like this, it is an avatar that is very simple and purely showing only body movements.



The background at the time of recording can be changed by tapping 'Background'.



In addition to the 'default' with a white grid on a black floor, you can choose from green (#00ff00), blue (#0000ff), white (#ffffff), and a custom color that allows you to set your own color code.



Here's what I set to green. If you record as it is and set it to cut out the green on the editing software, it is possible to make the background transparent.



By combining a movie recorded with a green background and a real movie with chromakey, you can also create a movie like the one below.

I tried chromakey synthesis of avatar recorded with mocopi's application and reality - YouTube


In addition, if you tap 'Microphone' and select 'OK' and grant microphone authority to the application, you can also record audio when recording. If the mouth part of the avatar is movable, you can perform lip sync by moving the lips according to the speaking voice.



When you turn on the microphone, you will be asked to access the microphone for the first time, so tap 'OK'.



When I actually used mocopi, I thought that its main feature was that it was small and light. Devices for full tracking that can be linked to VR devices are quite large and heavy, and they get in the way of actual movement, which inevitably impairs the sense of immersion. However, mocopi is light and small, and the tracking accuracy is high. For example, the VIVE tracker , which is a general VR tracker, is 70.9 mm x 79.0 mm x 44.1 mm in size and weighs 75 g, while mocopi is 32 mm x 11.6 mm and weighs about 8 g. In the future, it is planned to cooperate with content such as VRChat, and it will break the image of ``Motion capture for full tracking is a heavy and bulky device'' in a good way.

The nominal maximum continuous motion capture usage time is about 10 hours, and the charging time is about 1.5 hours, so it is easy to use. It is small and easy to carry, and can be used just by linking with a smartphone, so it is useful for people who say, ``I have a 3D avatar, but I don't have the space or equipment to track captures.'' In addition, while working as a VTuber, it can be said that it is a perfect item for those who say, ``You can't deliver using 3D avatars unless you have a studio with expensive equipment.''

Mocopi is scheduled to appear on January 20, 2023, and the price is 49,500 yen including tax.

in Review,   Mobile,   Software,   Hardware,   Video, Posted by log1i_yk