Finally, YouTube will install 'automatic translation dubbing' function by AI
Aloud, which is part of
Aloud - dubbing for everyone
https://aloud.area120.google.com/
YouTube is getting AI-powered dubbing - The Verge
https://www.theverge.com/2023/6/22/23769881/youtube-ai-dubbing-aloud
You can check what the dubbing function of YouTube actually looks like in the following movie.
Aloud: Let's overcome the language barrier in videos together-YouTube
If you click the gear icon at the bottom right of the player in the above movie, there is an item called 'Audio track (5)', and you can switch to dubbed audio from here.
In addition to the original English voice, you can select Spanish, Indonesian, Portuguese, and Hindi as dubbed voices. When you actually switch, you can see that only the human voice is translated into another language and dubbed, while keeping the BGM flowing behind the movie.
According to IT news site The Verge, YouTube has already tested this automatic translation dubbing tool for hundreds of creators and plans to officially implement it in 2024. At the time of article creation, dubbing in English, Spanish, and Portuguese is possible, and more languages will be supported in the future.
'We are working to make the translated audio tracks sound like the creator's voice with more expressiveness and lip-syncing,' YouTube said. It should be noted that this 'lip-syncing' is believed to be the AI technology 'Universal Translator' revealed at the keynote speech of Google's developer conference ' Google I/O 2023 ' held in May 2023. increase.
Google is developing automatic dubbing of movies & lip sync AI, it is possible to dub without changing the voice tone and it is too high performance to be careful of abuse - GIGAZINE
Related Posts:
in Web Service, Video, Posted by log1i_yk