Teradata to BigQuery Migration
RetailBusiness Impacts
50%
Reduction in infrastructure cost
60%
Reduction in the query execution time
140TB+
Historical data migrated
10+
Data sources were aggregated for data
Customer Key Facts
- Country : Argentina
- Industry : Retail
Problem Context
A Latin American e-commerce enterprise, which boasts a user base of over 150 million in more than 15 countries, encountered significant challenges with its present data infrastructure. To drive business growth, the company needed a comprehensive understanding of data that was dispersed through various sources.
Challenges
- Low performance and system maintenance with an increase in data size
- High latency affecting customer experience
- Continuously increasing operational and maintenance costs
Technologies Used
Big Query
Cloud Storage
Dataproc
DataFlow
Cloud Data Fusion
Migrated data from Teradata and other disparate data sources to BigQuery
Solution
Quantiphi worked as a strategic partner to migrate data from Teradata and other disparate data sources to BigQuery and enabled data sharing across various business teams and departments.
Following a detailed discovery, we assisted the client in transferring tables/entities from various data sources, including MySQL, Oracle, Hive, and SQL Server, into BigQuery.
Results
- Created a single unified view of data from different environments
- Processed 2,000+ ETL jobs and orchestrated 1,300+ jobs
- Increased dashboard adoption