Microsoft unveils new AI feature for Edge that translates YouTube videos in real time with dubbing and subtitles



On May 20, 2024 local time, Microsoft announced a feature for its web browser, Microsoft Edge, that uses AI to translate videos posted on sites such as YouTube in real time and provide dubbing and subtitles.

Microsoft Edge will translate and dub YouTube videos as you're watching them - The Verge

https://www.theverge.com/2024/5/21/24160664/microsoft-edge-real-time-video-translation-ai



Microsoft Edge now offers real-time translation and dubbing of videos

https://www.androidheadlines.com/2024/05/microsoft-edge-getting-real-time-translation-and-dubbing-of-videos.html

Microsoft Edge will use AI to add real-time translation to videos: 3 new features | Mashable
https://mashable.com/article/microsoft-edge-real-time-video-translation-explained

Sites that support real-time video translation on Edge include YouTube, LinkedIn, Coursera , and news sites such as Reuters, CNBC, and Bloomberg.

These sites offer real-time translation from English to German, Hindi, Italian, Russian, Spanish or from Spanish to English.

Microsoft has released a demo of the real-time translation feature in the video below.

Real Time Video Translation - YouTube


To use the translation, click the 'a/あ' button that appears on the screen while the video is playing.



Select the language of the video being played and the language you want to translate.



Check either 'Audio' or 'Subtitles' or both for which you want to provide translations, and click 'Translate.'



Processing will proceed.



Within seconds of starting the process, the English voice was replaced with a synthesized Spanish voice.



Microsoft said about this feature, 'There are a huge number of videos on the Internet, but many of them have problems such as language barriers that make it difficult to understand them or hearing impairments that make them difficult to enjoy,' and indicated that the real-time translation function could be a catalyst for overcoming these challenges. In addition, they also revealed that they have plans to expand the supported languages and video platforms in the future.

in Web Service,   Video, Posted by log1r_ut