Meta AI Translations for Creators: English & Spanish Launch

Meta Introduces AI-Powered Voice Translation for Global Reach

Meta has announced the widespread release of an artificial intelligence-driven voice translation capability for users of both Facebook and Instagram, effective immediately.

Expanding Content Accessibility

This new functionality, available wherever Meta AI is currently supported, empowers content creators to translate their material into different languages. This broadened accessibility aims to connect them with a significantly larger viewership.

Initial announcements regarding this feature were made during Meta’s Connect developer conference last year. At that time, plans were outlined for pilot testing automatic voice translations within reels on both Facebook and Instagram platforms.

Authentic Dubbing with AI

Meta emphasizes that the AI-generated translations will replicate the original creator’s vocal characteristics. This ensures the dubbed voice maintains an authentic sound and tone when presented in a new language.

Furthermore, creators have the option to utilize a lip-sync feature. This aligns the translated audio with their lip movements, enhancing the naturalness of the viewing experience.

Initial Language Support and Eligibility

Currently, the feature facilitates translations between English and Spanish, with plans for the inclusion of additional languages in the future.

Access to these AI translations is granted to Facebook creators who have accumulated 1,000 or more followers. All public Instagram accounts globally, within regions where Meta AI is available, are also eligible.

How to Utilize the Translation Feature

Creators can initiate the translation process by selecting “Translate your voice with Meta AI” prior to publishing a reel.

They can then activate the translation toggle and choose whether to incorporate lip-syncing. Upon clicking “Share now,” the translated version will become automatically available.

Preview and Control Options

Creators are able to preview both the translation and lip sync before public posting. They retain the ability to disable either option at any time. The company clarifies that declining a translation will not affect the original reel.

Viewers of translated reels will see a notification at the bottom of the screen indicating that Meta AI was used for the translation. Users who prefer not to view translated reels in specific languages can disable this feature within their settings.

Insights and Performance Metrics

A new metric has been added to the Insights panel, allowing creators to monitor views segmented by language. This data will prove valuable in understanding how translations contribute to reaching new audiences, particularly as more languages are supported.

Best Practices for Optimal Results

Meta recommends that creators maintain a forward-facing position, articulate clearly, and avoid obstructing their mouths during recording. Reducing background noise and music is also advised.

The feature currently supports a maximum of two speakers, who should refrain from speaking simultaneously to ensure accurate translation.

Expanded Dubbing Capabilities

Facebook creators now have the ability to upload up to 20 pre-recorded dubbed audio tracks to a reel. This expands their potential audience beyond English- and Spanish-speaking demographics.

This functionality is accessible through the “Closed captions and translations” section of the Meta Business Suite and allows for the addition of translations both before and after publication, unlike the AI-powered feature.

Future Language Expansion

While Meta has confirmed that additional languages will be added in the future, specific languages and timelines have not yet been disclosed.

Vision for Global Connection

Adam Mosseri, head of Instagram, explained in a post that the goal is to connect creators with audiences who may not share the same language.

He stated that by breaking down cultural and linguistic barriers, Meta aims to facilitate follower growth and enhance the value creators derive from the platform.

Restructuring of Meta’s AI Division

The launch of this AI feature coincides with reports indicating a restructuring of Meta’s AI group. The reorganization focuses on four core areas: research, superintelligence, product development, and infrastructure.