NHK is developing software to convert instantly into sign language CG when entering text

In NHK programs, sign language may be used for those with hearing impairment, so that people drawn in CG can perform on behalf of those who are performing sign language while moving their hands NHK is doing the research that I will do.

The theme of the research is "translation into sign language CG targeting weather information", and now the program is focused on the sign language weather forecast, which is relatively patterned content.


It is designed to run on a general Windows PC, translate sentences entered in text into sign language and output in CG format.


In the weather forecast that "Tomorrow will be sunny nationwide and the temperature will rise", if you type a familiar expression ......


Sign language CG starts to move with almost no time lag.


The way CG women actually sign language is seen below.

Translations from text data under study by NHK to Sign Language CG look like this - YouTube


Sign language that corresponds to nearly 90,000 Japanese is prepared, and in the future we aim to respond to news and variety other than weather. Also, he seems to consider studying sign language automatically according to speech corresponding to voice input.


Examples of sign language are as follows.




In addition, there is an old version in this CG sign language model, which is a man with a white shirt on the right side of the screen.


Although it is a friendly appearance, it is said that there are few expression variations and clothes textures compared to the new version.


In the new version, it has become quite impressive impression.


The demonstration of this technology will be held on May 27 (Sun) in Setagaya-ku, Tokyo "STRL Open 2012As you can see, those who are interested please try.