As a topic that the idea of power technique to 'shoot with green whole body tights' to bring real objects to the virtual world can be a historical turning point
The activity of Virtual YouTuber (VTuber) which performs various delivery while moving a 3D avatar using motion capture has an infinite possibility by setting the world in the electronic brain world, while bringing in real objects and utilizing it There was a difficult thing. Meanwhile, I will experiment the idea to solve with a power technique called "Can carry real things with virtual body if motion capture and permeation are performed while wearing green whole body tights and carry real things" The movie has been released as a hot topic by Tsunotsuto .
You can see in real life the way you actually lift and knock real objects with the virtual body in the following movie.
Test avatar to bring real things 4 pic.twitter.com/Uk9sd6bqBw- Natsumoto (@ natsunot) January 1, 2019
Up to now, "a method of bringing real objects into virtual space" was being studied. As an example, Twins' VTuber · お め はSisters has practiced the method using 3D scan with the following movie.
I scanned Gundam for 3D screens and tried Gundam fight - YouTube
In the movie, first of all, Gundam's plastic model (Gundam) will be created, but the contents of the plastic model are introduced with still images. It is skillfully edited as if the Gundam model itself appeared in the virtual world, but it is just a capture of a picture, you can not assemble a gundam directly in the virtual world.
And finished gundam is done by doing 3D scan. Although it is an innovative project that brings real objects to the virtual world, there are limits to simple scanning with the application, and it means "It was different from what I thought".
In this way, in order to bring real objects to the virtual world, as one of "Introduction with still images", "3Dization with rough scanning of repeatability" or "3D modeling exactly like real life" was used, Natsuto announced on Twitter the following movie.
If you wear whole green tights on the green back and use virtual motion capture,- Natsumoto (@ natsunot) January 1, 2019
Can you let avatar have real things?
...... I tried the delusion. pic.twitter.com/txMFKxqVoK
Amazon's cardboard is lifted by 3D avatar. The background is real outdoors, the one that is moving is the avatar in 3D, the one with the cardboard is what it is synthesizing with the room, and how much what is synthesized It is quite difficult to understand the mechanism by looking at it.
It is like throwing cardboard and playing. In still images it is difficult to produce a stereoscopic effect and it can not be handled with it and it can not be played and it was difficult to reflect the small movement that the lid opens and closes also in 3D scanning and modeling, In the movie, the virtual existence and the real item merge smoothly.
In a movie posted as "Test 2 to bring an actual thing to an avatar", this also captures the feeling of the towel's shimmer which is difficult to reproduce 3D.
Also, in scanning and modeling it is quite difficult to deform the object deeply, but in this way it's easy to fold the towel.
These movies are centered on the idea of " chroma key composition " that makes certain colors transparent and synthesizes different images there. In order to capture a real object into the virtual world, it is necessary to shoot a target item on a green background (greenback) and to transmit green. In order to further move the item furthermore, it adopts a means of "photographing with green full-body tights and passing through their own appearance".
On the display of virtual motion capture,- Natsumoto (@ natsunot) January 1, 2019
Combine the Web camera image with chromakey and synthesize (use OBS).
We synthesize the synthesis result with the game screen (H3GVR) with LIV and shoot it.
The shooting scenery is instantly dead if someone sees it. pic.twitter.com/tY0S7kMsiM
It seems to be a power skill already used in other fields, but it became a topic that it was just a simple "Columbus egg" idea that nobody could think of as simple. Popular cat ears VTuber · cute movement Norakyatto to operate the wild cat P -san, has been praised as "VTuber is it break through that so that it is the reality of the article reviews and introduction".
Well, this is a brain muscle more than myself but it's amazing ... ... it's a breakthrough!- Noraneko P (@ VR_Produce_Nora) January 2, 2019
You can do all the reality article reviews and introductions.
An infinite polygon reality object model can be brought in without modeling! https://t.co/x8dLLauA32
In this idea it is only transparent through the green background and the whole body tights, so it was a difficulty to see a black tracker that senses the movement of the hand ... ...
This is also solved by force technique that paints the tracker in green.
Tracker is like this, the band that I fix in my hands diverted the green thing I used last time, so the band part of my hand is gone.- Natsumoto (@ natsunot) January 3, 2019
Also, the model side does not hide the hand but it is just a miscellaneous specification. pic.twitter.com/DQ2jO2uauQ
Although it did not go well, I will post what I tried in addition to reporting.- Natsumoto (@ natsunot) January 3, 2019
<What I tried>
1. Erase the tracker (almost successful)
2. Bring in the hands of reality (Well, hmm?)
3. Place the cloth on the face and eat and drink (too much preparation ...... to various results on the Hydoy) pic.twitter.com/9bd8muDUxv
It was done until the creation of a green tracker by volunteers.
it is complete! Hole size (Chromakey priority or recognition accuracy priority) Since I did not know which one was better, I made 2 patterns, so I appreciate your evaluation! pic.twitter.com/cT7DsSb50n- Lute (@ RyutoAI 2 x m) January 4, 2019
Like VTuber, shooting movies with 3D avatar fashion is still short history, new ideas and platforms are appearing more and more in various forms. The idea of the whole body tights of this time can also be expected to penetrate as a standard of VTuber at the end of being refined more in the future.