Enhancing Cloud Security & Infrastructure Automation for AvaSure: Faster Development, Lower Latency
HealthcareBusiness Impacts
Enhanced Time to Development
Accelerating development through automation, reducing time-to-market.
Reduced Latency
Optimizing cloud infrastructure for faster model serving and improved performance.
Customer Key Facts
- Country : USA
- Industry : HCLS
Company Overview
AvaSure® is an intelligent virtual care platform trusted by over 1,100 hospitals, empowering healthcare providers to engage with patients, optimize staffing, and seamlessly integrate remote and in-person care at scale. The platform features AI-powered virtual sitting and virtual nursing solutions, meets the highest enterprise IT standards, and drives measurable outcomes with support from care experts.
Business Scenario
AvaSure’s commitment to upholding the highest standards of security and innovation led to a strategic partnership with Quantiphi, accelerating development on Oracle Cloud Infrastructure (OCI). Through this collaboration with Quantiphi and Oracle, AvaSure fortified its cloud architecture on OCI, ensuring best-in-class network, scalability of machine learning model inference services, and optimized automation of infrastructure provisioning via CI/CD integration.
Customer Objectives
- Streamlining Customer Onboarding – The focus was on automating the infrastructure provisioning process to ensure a seamless and swift onboarding experience for new customers.
- Enhancing Inference Efficiency – AvaSure aimed to elevate their inference capabilities by developing a scalable pipeline leveraging NVIDIA Deepstream, Triton, and Kubernetes.
- Strengthening Network Infrastructure – The objective was to build a robust network architecture, including meeting HIPAA compliance.
Technologies Used
API Gateways
VPN Connections
Oracle Kubernetes Engine (OKE)
OCI Container Registry
NVIDIA Triton Inference Server
Solutions
Model Conversion and Optimization
The project’s focus on model conversion and optimization ensured seamless deployment in the cloud environment. Utilizing the NVIDIA Triton Inference Server, Quantiphi achieved efficient request handling, significantly reducing latency and improving overall inference times. This setup allowed for real-time processing of medical data, providing timely and accurate results essential for patient care.
Robust Cloud Architecture
A robust cloud architecture with AI ML focus was designed and streamlined access to hospital servers from the cloud. Key components of this architecture included:
- OCI Network Resources: Route lists were optimized for pairing between Virtual Cloud Networks (VCNs) and OCI managed services, ensuring secure and efficient data flow.
- Scalable AI Platform To handle the dynamic and high-demand nature of AI workloads, Oracle Kubernetes Engine (OKE) clusters were used. This orchestration provided the necessary scalability, allowing the platform to adapt to varying loads and ensure continuous availability. Additionally, OCI managed databases, such as Autonomous Transaction Processing (ATP), were integrated as the data layer, offering reliable and high-performance data management.
Results
The project accelerated AvaSure’s AI ML transformation on OCI in healthcare service delivery by rapidly enhancing AI capabilities and partnering with a trusted provider for scalable cloud deployment. Key outcomes include:
- Improved Infrastructure - Enhanced network and platform for machine learning workloads, ensuring the resilient protection of sensitive healthcare data from hospitals for HIPAA and HITRUST compliance.
- Enhanced Time to Development - Increased developer productivity through automated checks for code scanning, quality control for deployment workflows, and reduced go-live time for newly onboarded users by automating infrastructure processes.
- Reduced Latency - Optimized model serving infrastructure for cloud deployment to efficiently handle multiple requests, resulting in improved performance, reduced latency, and greater scalability.
Utilizing Triton Inference Server and OCI resources, Quantiphi helped AvaSure to improve operational efficiency and set a new standard for AI deployment in the healthcare industry, driving meaningful change and improving patient outcomes.
