"Interpreter phone" function from NTT docomo and "Elephant asking for wish" service displayed as reference

At Wireless Japan 2011, from NTT DoCoMo"Automatic interpreting during call"A demonstration of the system that can do is done.

In the system that places an interpretation server on the cloud and interprets with voice and letters during a call, if services are actually started, in principle any terminal capable of voice communication can be handled about. further"Elephants listening to a wish"It is very interesting to know what kind of content it is, because there is a demonstration of it.

Details about elephants listening to interpreter phone calls and asking from the following.Wireless Japan 2011 / 2nd Radio Technology Application Industry Exhibition

NTT DoCoMo booth's interpreter phone experience section.


An interpreter phone demo screen is displayed on the screen.


Communication with NTT DoCoMo's R & D center in Yokosuka is connected, and the screen currently being displayed is that the screen on the Yokosuka side is displayed.


Interpreting results will be displayed in real time following voice.


In order to actually experience the interpreter phone at the venue, Bob, the native speaker, will ask questions for the phone.


Especially in the venue, many people gather at the booth of the interpreter phone, and because it is very rough, I thought that I heard that noise entered "Where did you come from?" Where did you sleep well? (Where did you sleep well?) ".


Visitors answer Bob's question. Because there are many noises, I press down my mouth and pronounce it.


Click "Translation start" button.


The question "It's Nishinomiya City in Hyogo Prefecture" was properly recognized and translated as "It is Nishinomiya of Hyogo." You will hear an interpreter by voice prior to displaying the screen.


The screen you saw with the actual smartphone Xperia. Although this translation screen is provisionally made on the Android platform, the system itself can also correspond to feature phones by making it an application.


Although there was a system that recognizes voices and translating so far, this system allows you to do it in real time during a call.


And here is a demonstration screen of "Elephants listening to your wish".


When launching during a call, "Elephant speaks to me" Please tell me your wish.


When asking "Please tell me how to get to the Tokyo station from the international exhibition hall", I recognized "Tokyo" "International exhibition hall" "way of doing". When you click "Request execution" in the lower left, you search with goo.


The search result was displayed. This screen is shared with the other party of the call, and it is possible to share the searched information at the same time with the other party.


The elephant has the function of selecting the optimum search engine according to the contents of the request, and when it recognizes "Tokyo" "sightseeing spot", it searches for "Jalan". Moreover, it can also be linked with the schedule function, etc. It also has a function to adjust the schedule by comparing the callee's schedule and your schedule.


The movie below shoots the state of the demo using an elephant which actually hears an interpreter phone and a request. Since you can hear the sound actually exiting from the phone, you can check at what timing the interpreter phone will respond. Also, in an elephant demonstration, you can also see the schedule adjustment screen actually.

YouTube - NTT docomo "Interpretation call" "Elephant listening to wish" demonstration movie