Twitter Expands Google Cloud Partnership

Twitter Deepens Google Cloud Partnership for Enhanced Data Analytics

Twitter is significantly enhancing its data analytics capabilities through an expanded, long-term collaboration with Google Cloud. This partnership aims to unlock deeper insights from user activity and improve the overall platform experience.

Initial Collaboration and the "Partly Cloudy" Strategy

The social media platform initially began working with Google back in 2018. This initial phase involved migrating Hadoop clusters to the Google Cloud platform, a move that was part of Twitter’s broader Partly Cloudy strategy for infrastructure modernization.

Expanding to Google’s Data Cloud

The newly expanded agreement will see Twitter transition its offline analytics, data processing, and machine learning workloads to Google’s Data Cloud. This represents a substantial commitment to Google’s suite of data analytics tools.

Faster Data Analysis for Improved User Experience

According to Sudhir Hasbe, Google Cloud’s director of product management and data analytics, this move will empower Twitter to analyze data at a faster rate. The ultimate goal is to deliver a more refined and personalized user experience.

Every interaction on Twitter – tweets, likes, and retweets – generates valuable data. This data is crucial for understanding user behavior and tailoring content preferences.

The Scale of Twitter’s Data Platform

Twitter’s data platform is immense, processing trillions of events, managing hundreds of petabytes of data, and executing tens of thousands of jobs across more than a dozen clusters on a daily basis.

Leveraging Google’s Data Cloud Tools

By broadening its partnership, Twitter is adopting key components of Google’s Data Cloud. These include BigQuery, Dataflow, BigTable, and a range of machine learning (ML) tools. These tools will be instrumental in interpreting data and optimizing Twitter’s features.

Positive Outcomes from the Initial Partnership

Twitter CTO Parag Agrawal stated that the initial collaboration proved successful, leading to increased productivity within the engineering teams. He emphasized the potential for further advancements.

“Expanding on this relationship and utilizing Google’s technologies will enable us to extract more value from our data, accelerate development cycles, and deliver more relevant content to our users,” Agrawal explained.

Scalability and Reduced Infrastructure Burden

Google Cloud’s Hasbe highlighted the necessity of a highly scalable analytics platform for organizations like Twitter. He noted that the expanded partnership will unlock a wider range of use cases within the cloud environment.

“Our platform is serverless, allowing us to automatically scale resources up or down as needed,” Hasbe shared with TechCrunch. “Twitter can analyze vast datasets and gain insights without the complexities of infrastructure management, capacity planning, or server provisioning.”

Empowering Data Scientists and Predictive Analytics

The transition will also streamline the process for Twitter’s data scientists and related personnel to construct machine learning models and perform predictive analytics.

Other Companies Utilizing Google Cloud

Several other organizations have recently turned to Google Cloud for support, including Bed, Bath and Beyond, Wayfair, Etsy, and The Home Depot.

Google Cloud’s Financial Performance

Recent reports indicate that while Google Cloud is experiencing accelerated revenue growth, its losses are also increasing. As reported by Frederic Lardinois on February 2nd, Google Cloud incurred a loss of $5.6 billion in fiscal year 2020, despite generating $13 billion in revenue.