Google scored a significant storage win from Twitter that will see more than 300 petabytes of storage and Hadoop clusters migrated to Google Cloud Platform (GCP).
Hadoop is an open source platform designed to deal with large amounts of unstructured data and was initially developed by Google and Yahoo. Twitter runs multiple Hadoop clusters across tens of thousands of servers for storage and analytics.
Twitter CTO Parag Agrawal noted in a blog post that the move followed an assessment of the company’s platform and infrastructure needs to support growth. While not specifically implied, Agrawal’s post hinted that the data being moved was coming from Twitter’s own internal data center resources.
“This migration, when complete, will enable faster capacity provisioning; increased flexibility; access to a broader ecosystem of tools and services; improvements to security; and enhanced disaster recovery capabilities,” Agrawal wrote. He added that the move would also allow for the separation of compute and storage for Hadoop workloads, which will help with scaling and operations.
The security aspect could come in handy as Twitter just yesterday sent out warnings to users to update passwords due to a possible internal bug.
Win for Google
The move is a feather in the cap for Google, which is looking to gain ground on its larger public cloud provider competitors in Amazon Web Services (AWS) and Microsoft Azure. Recent reports have indicated that Netflix, which has been the poster child for running services across AWS, is looking to move some of its resources to GCP.