One new tool showcased at the event is Google’s universal translator, an experimental AI video dubbing service that translates speech in real-time. The model works in four stages, matching lip movements in a video to recognised words, providing instant speech generation, using intonation to aid translation and finally replicating the style and tone to generate the translation.
Although the universal translator feature isn’t yet available outside of a small testing group, it could be rolled out to services such as YouTube and Google Meet once Google has tested numerous safeguards. Being able to translate live videos in real-time into multiple languages could be an incredibly useful tool, expanding a YouTube channel’s global viewership and allowing for more collaborative projects across countries.
