5x Improvement in inference time with GCP accelerators (TPUs)
Optimized cost-to-performance ratio with GCP accelerators
Up to 93% reduction in model training time using GCP TPUs
Snorkel AI’s platform enables data scientists to bring high-quality models to production faster with an iterative, interactive data-centric AI approach powered by programmatic labeling and foundation models. The Snorkel AI Research team wanted to evaluate the impact of running transformer models (CLIP/Owl-ViT) on GCP accelerators. The client aims to improve latency and optimize costs by using GPUs and TPUs in GCP’s preprocessing and training workflow.
Snorkel Al seeks to achieve the following objectives:
1. Explore the possibilities to leverage GCP GPUs and TPUs to accelerate current ML workflows leading to faster inference and training duration
2. Benchmark the results based on costs incurred and time taken
Google Cloud Filestore
Google Cloud Compute
Vertex AI Workbench
Google Cloud TPU VM
Google Cloud Functions
Google Cloud Scheduler
Cloud VPC
Google Cloud Storage
Cloud Monitoring
Cloud Logs
Quantiphi worked with Snorkel AI to develop the solution in three phases:
As part of the engagement, Quantiphi was successfully able to:
“Quantiphi has been an excellent partner as we explore how Google Cloud TPUs can accelerate AI/ML workloads and enable new interactive workflows for foundation model fine-tuning and training. The Quantiphi team was professional, well-organized, and kept the project on track to ensure completion on schedule. Not only did we have a great experience working with Quantiphi, the project was successful and we saw excellent results on inference and training throughputs.”“
Braden Hancock, Co-Founder and Head of Research, Snorkel AI
