ElevenLabs, an AI startup, has introduced an AI dubbing system that enables content creators to seamlessly translate and generate dialog in over 20 languages while preserving the authentic voices of actors. This innovative technology draws inspiration from Disney’s extensive localization efforts and offers an efficient solution for making content accessible to a global audience.
Traditionally, after Disney releases a film in English, it embarks on the formidable task of localizing it into as many as 46 global languages, using its dedicated division, Disney Character Voices International Inc. Each version features local voice actors, resulting in unique audio experiences for audiences worldwide.
However, ElevenLabs’ AI dubbing system takes a different approach. It leverages artificial intelligence to replicate actors’ voices closely, eliminating the need for labor-intensive dubbing efforts. With the ability to work in more than 20 languages, including Hindi, Portuguese, Spanish, Japanese, Ukrainian, Polish, and Arabic, this tool serves as a valuable resource for media companies, educators, and internet influencers seeking to adapt content for diverse audiences without the financial resources of a Disney-sized conglomerate.
This technology not only translates spoken content into the desired language within minutes but also generates entirely new spoken dialog in the target language, maintaining the emotion and intonation of the original performance. While it doesn’t involve the actors themselves recording in multiple languages, it creates AI-generated recreations that closely match the source material.
ElevenLabs CEO Mati Staniszewski emphasized the significance of this development, stating, “It will help audiences enjoy any content they want, regardless of the language they speak. And it will mean content creators can easily and authentically access a far bigger audience across the world.”
This AI dubbing system represents a significant leap forward in making content accessible and enjoyable for a global audience, aligning with the growing demand for multilingual content adaptation in an increasingly interconnected world.
