Meta AI dubs Instagram videos with lip-syncing
Meta is significantly expanding the reach of its artificial intelligence-powered translation tool, integrating it more deeply into Facebook and Instagram. This advanced feature is designed to automatically dub Reels content into different languages, aiming to dismantle linguistic barriers for creators and viewers alike.
At the core of this innovation is the system’s ability not only to translate spoken words but also to meticulously match the rhythm and intonation of the original speaker’s voice, and crucially, to synchronize the translated audio with the movement of their mouth. This lip-syncing capability represents a notable leap beyond conventional dubbing, promising a more natural and immersive viewing experience by making the dubbed content appear as if the speaker is genuinely speaking the new language. Currently, the tool supports translation between English and Spanish, a capability Meta initially previewed at its Connect event last year, suggesting a strategic rollout with plans for broader language support in the future.
For creators on Instagram and Facebook, enabling this feature is straightforward. Before publishing a Reel, a simple toggle labeled “Translate voices with Meta AI” can be activated from the menu. The platform also provides creators with the option to review the dubbed video, including the lip-syncing, before it goes live, ensuring quality control. Once published, these translated Reels are automatically surfaced to users in their preferred language, enhancing content accessibility across diverse linguistic communities. To maintain transparency, all videos translated using this AI tool will bear a clear tag indicating its use.
The rollout of this translation capability is currently underway, targeting Facebook creators who have amassed a following of 1,000 or more, and extending to all public Instagram accounts. This phased introduction suggests Meta’s intent to gather feedback and refine the technology as it scales.
This initiative is part of Meta’s broader commitment to leveraging AI to foster global connectivity and enrich user experiences. By automating the translation and dubbing process, the company empowers creators to effortlessly reach a wider, international audience, potentially democratizing content creation and fostering cross-cultural engagement on its platforms. The emphasis on natural-sounding voice matching and precise lip-syncing underscores a push towards making AI-generated content feel less artificial and more genuinely communicative, marking a significant step in the evolution of multilingual content sharing on social media.