![case study](https://cdn.quantiphi.com/2024/03/219e0c5e-centralized-data-lake-414x481-1.png)
Centralized Cloud Native Data Lake
InsuranceBusiness Impacts
70%
Reduction in Time to Market
95%
Efficiency in Meeting SLAs
Customer Key Facts
- Location : North America
- Industry : Insurance
Problem Context
The client, a large insurance company, stored their data in multiple formats which resulted in data duplicacy. They sought to build a centralized, cost-effective, and scalable data platform hosting for low-latency delivery to enterprise customers around the world with self-service BI capabilities.
Challenges
- Use of Different Data ingestion and ETL techniques for streaming and historical data
- Due to GDPR and compliance issues data lake had to be built in the Ireland region on AWS
- Business had around 1600 tables and a lot of attributes to work with for reporting
- Absence of proper Data dictionary and Data Lineage tracking feature
![](https://cdn.quantiphi.com/2024/03/e7c2f15c-challenges_centralized-cloud-native-data-lake.png)
Technologies
![Amazon Redshift](https://cdn.quantiphi.com/2024/02/Amazon-Redshift_light-bg@4x-1.png)
Amazon Redshift
![Amazon S3](https://cdn.quantiphi.com/2024/02/9c40e5d8-amazon-s3.png)
Amazon S3
![Amazon EC2](https://cdn.quantiphi.com/2024/02/Amazon-EC2_light-bg@4x.png)
Amazon EC2
![Amazon DMS](https://cdn.quantiphi.com/2024/02/02cac3d5-aws-database-migration-service-aws-dms.png)
Amazon DMS
![AWS Lambda](https://cdn.quantiphi.com/2024/02/83e09c49-aws-lambda.png)
AWS Lambda
Migrated data from multiple on-site data sources to the cloud and established a centralized data lake platform
Solution
Quantiphi helped the client migrate data from multiple on-site data sources to the cloud and established a cost-effective, scalable, and centralized data lake platform on the cloud by setting up an intake pipeline with security protocols and enabled them to view and gain insights in real-time.
Result
- Built a cost-effective Data Lake enabling faster insights and time to market
- Less Delays in Data Processing, ETL Jobs, and BI Reporting