AI Translation Startup Palabra Receives Funding from Reddit Co-founder

Palabra AI Secures $8.4 Million to Advance AI-Powered Speech Translation

A new company, Palabra AI, is focused on improving the capabilities of artificial intelligence in the realm of speech translation. They are addressing a particularly challenging area within the broader field of large language models (LLMs).

The Challenges of Speech Translation

While LLMs have significantly enhanced text-based translation, replicating this success with spoken language presents unique hurdles. Reddit co-founder Alexis Ohanian highlights that speech translation demands real-time processing and a natural-sounding voice output.

“AI excels at content generation and text translation, however, speech translation introduces complexities due to the need for instantaneous language switching and human-like vocal delivery,” Ohanian explained.

Investment from Seven Seven Six and Others

Recognizing Palabra AI’s potential, Seven Seven Six (776), led by Alexis Ohanian, is spearheading an $8.4 million pre-seed funding round. Additional investors include Creator Ventures, as well as individual contributions from Max Mullen, co-founder of Instacart, Anne Lee Skates, a former partner at a16z, Mehdi Ghissassi, previously Head of Product at DeepMind, and Namat Bahram.

Ohanian emphasized that Palabra AI’s strong product development and the expertise of its team were key factors in the investment decision.

“Palabra demonstrates a remarkably smooth translation process. The company boasts a highly skilled AI research team dedicated to producing quality speech technology, coupled with thoughtful product design and exceptional output,” he stated.

Founding and Motivation

Palabra AI was established in 2023 by Artem Kukharenko and Alexander Kabakov. Kukharenko, formerly a machine learning engineer at Samsung, drew upon personal experiences as a digital nomad encountering language barriers.

He sought to leverage his machine learning background to create a solution for real-time translation needs.

Reducing Latency for Seamless Translation

Kukharenko explained that previous attempts at translation often suffered from high latency due to the combination of speech-to-text and text-to-speech technologies. Palabra AI has successfully reduced this latency to 800ms, achieving a more fluid and real-time translation experience.

“Many companies have attempted to resolve the translation issue, but combining various technologies, including speech-to-text and text-to-speech APIs during translation, resulted in increased latency and a less authentic real-time feel. We’ve managed to lower latency to 800ms with Palabra, creating a seamless and instantaneous translation,” he shared.

Scalable Language Support and Quality Control

The company has developed a custom data pipeline that enables rapid integration of new languages, often within weeks. A human interpreter is incorporated into the final stage of this pipeline to ensure the accuracy and quality of the translated output.

Furthermore, the algorithm is designed to handle challenging conditions such as noisy environments and interruptions.

Consumer and Business Applications

Palabra AI offers translation products for both individual consumers and businesses. A desktop application, compatible with Mac and Windows, integrates with popular video conferencing platforms like Google Meet, Zoom, Discord, Slack, and Microsoft Teams.

This application supports translation across more than 30 languages, allowing users to hear conversations in their preferred language.

The company’s website indicates that the desktop app will soon include native translation capabilities for content platforms such as YouTube, Netflix, Twitch, and Vimeo.

Users receive 30 minutes of free translation each month, with paid plans starting at $25 per month for 60 minutes of translation access.

Enterprise Solutions

Palabra AI also provides APIs and SDKs, enabling businesses to integrate translation functionality directly into their own products.

Currently, their technology powers video platforms like Agora for live multilingual broadcasts. Language service providers, such as GIS Group, are utilizing Palabra’s tools in conjunction with human interpreters.

Event organizers are also leveraging the technology to deliver multilingual live streams.

Competitive Landscape

The translation market is competitive, with startups like EzDubs, backed by Y Combinator, developing apps for in-person and call conversations. Google recently launched real-time translation for video calls within Meet.

On the business side, companies like Camb.AI, based in Dubai, are creating translation technology for live event broadcasting.

Future Development

To differentiate itself, Palabra AI is developing a new streaming prediction model aimed at significantly reducing latency. They are also working towards supporting translation for over 10,000 simultaneous audio streams.

We are continuously striving for improvement, and your insights and feedback are invaluable to TechCrunch and our coverage. Please take a moment to complete this survey to share your thoughts and potentially win a prize!