Meta faces a €91 million fine for storing social media passwords in unencrypted databases, violating GDPR four times. This latest penalty adds to a string of data security infractions by the tech giant, highlighting the critical need for robust password protection measures in the digital age. Learn about the implications for users and the tech industry in our comprehensive analysis.
Parth
Tech News
2 min read

Meta AI Now Translates, Dubs, and Lip-Syncs Reels Across Languages

Meta has introduced a groundbreaking feature that allows Reels on Facebook and Instagram to be automatically translated, dubbed, and lip-synced in multiple languages including English, Spanish, Hindi, and Portuguese. This AI-powered technology uses advanced voice cloning to mimic the original creator’s tone, accent, and cadence, and even adds realistic lip-sync so the audio matches the video, making the whole experience feel seamless and immersive.

Here’s a deeper look at what this means for creators and audiences:

For creators:

  • Creators can now unlock a global audience without investing heavily in localization, dubbing actors, or third-party tools.

  • On Facebook, this feature is available to creators with at least 1,000 followers, and on Instagram, it’s open to all public accounts in supported regions.

  • Meta AI handles not just text translation, but also generates an audio track in the target language that sounds like the real voice of the creator. Lip movements in the video are adjusted with AI so viewers see natural, in-sync dubbing.

  • This opens new opportunities for educational content, music, guides, and entertainment to be watched and understood by people around the world, regardless of the language spoken by the creator.

For viewers:

  • The AI-translated and dubbed Reels are clearly labeled—if you see “Translated with Meta AI” on the screen, you know you are watching the AI-enhanced version.

  • You can customize your viewing experience by toggling language translation or lip-syncing on or off, or by sticking with the original video if you prefer.

  • This makes it possible to watch a cooking tutorial from Brazil, fitness tips from India, or a trending dance video from Spain in your own language, all with lip-sync, matching tone, and clear context.

Meta’s AI approach goes beyond what’s available on other short-form video platforms. While YouTube and TikTok have introduced options for captions, subtitles, and basic translation overlays, Meta’s integration of full voice cloning and realistic lip movement matching sets a new standard. For now, YouTube does not offer real-time AI-on-the-fly dubbing with lip-sync, and TikTok’s translation overlays don’t match the realism or immersion Meta aims to bring.

There’s also a strategic benefit for Meta. As international content becomes more accessible, creators from less-represented languages can gain global followings. Audiences will discover videos that previously wouldn’t have crossed language barriers. This enhanced discoverability can reshape the entire user experience on both Instagram and Facebook, driving more engagement from diverse communities.

Finally, Meta emphasizes choice and control: viewers can always see which Reels are AI-dubbed, and creators maintain the option to keep their content in the original language. As AI translation technology improves, Meta says they plan to add support for more languages and refine voice and lip-sync accuracy even further.