Meta's AI voice translation feature rolls out globally
Meta has rolled out a new voice dubbing feature globally, which uses generative AI to translate voices with optional lip-syncing. The feature is currently available for translations between English and Spanish, with plans to add more languages in the future. At launch, the feature is restricted to Facebook creators with 1,000+ followers, but anyone with a public Instagram account can use it. The tool trains on the user's original voice and generates a translated audio track that matches the tone. The lip-syncing add-on then matches the mouth movements to the translated speech. Meta frames the feature as a way for creators to expand their audiences beyond their native languages, and it includes a by-language performance tracker. Similar features have been introduced by YouTube and Apple, demonstrating the growing trend of AI-powered voice translation tools in social media and communication platforms.
Note: This is an AI-generated summary of the original article. For the full story, please visit the source link below.