Apple Live Translation: Messages, FaceTime & Phone Calls - WWDC 2024

Apple Announces Real-Time Translation Capabilities

Apple is set to launch Live Translation, a new feature driven by Apple Intelligence, designed for use across Messages, FaceTime, and Phone applications.

According to Leslie Ikemoto, Apple’s director of input experience, this innovative functionality facilitates the translation of conversations in real-time.

How Live Translation Works in Messages

The Live Translation feature within Messages will automatically translate incoming text messages and present them in the user’s chosen language.

Conversely, as the user types and sends messages, their text will be instantly translated for the recipient.

Live Translation for FaceTime and Phone Calls

During FaceTime calls, the feature will generate live captions, providing a visual translation of the conversation.

For Phone calls, the system translates spoken words as they are uttered, delivering the translation audibly to the other party.

Users will also receive a spoken translation of the responses they receive, regardless of whether they are communicating with another Apple user.

Developer Integration

Ikemoto highlighted the ease with which developers can integrate Live Translation into their own communication applications using a newly provided API.

Language Availability

Apple has not yet disclosed the specific number of languages that will be supported by this new Live Translation feature.

The technology leverages Apple Built models, ensuring all processing occurs directly on the device to maintain user privacy.