YouTube has announced its plans to launch a new AI-powered dubbing tool that will assist creators in translating their videos into different languages, aiming to help them reach a global audience. Revealed at VidCon 2023, this initiative seeks to provide creators with a convenient and cost-effective solution for translating content they do not speak themselves. The tool will utilize Aloud, developed by Google, and will incorporate the expertise of the AI team from Area 120, an experimental tech division within YouTube’s parent company.
The translation system, as described on the official Aloud website, begins with the AI transcribing the video into a script. Creators can then edit the transcription to correct errors, add clarifications, or highlight critical text where timing is crucial. The edited script is then returned to Aloud, which automatically translates the video into the desired language. Once completed, creators can upload the new audio tracks onto their original video to publish the newly dubbed content.