Solutions

Model Conversion and Optimization

The project’s focus on model conversion and optimization ensured seamless deployment in the cloud environment. Utilizing the NVIDIA Triton Inference Server, Quantiphi achieved efficient request handling, significantly reducing latency and improving overall inference times. This setup allowed for real-time processing of medical data, providing timely and accurate results essential for patient care.

Robust Cloud Architecture

A robust cloud architecture with AI ML focus was designed and streamlined access to hospital servers from the cloud. Key components of this architecture included:

OCI Network Resources: Route lists were optimized for pairing between Virtual Cloud Networks (VCNs) and OCI managed services, ensuring secure and efficient data flow.
Scalable AI Platform To handle the dynamic and high-demand nature of AI workloads, Oracle Kubernetes Engine (OKE) clusters were used. This orchestration provided the necessary scalability, allowing the platform to adapt to varying loads and ensure continuous availability. Additionally, OCI managed databases, such as Autonomous Transaction Processing (ATP), were integrated as the data layer, offering reliable and high-performance data management.

Results

The project accelerated AvaSure’s AI ML transformation on OCI in healthcare service delivery by rapidly enhancing AI capabilities and partnering with a trusted provider for scalable cloud deployment. Key outcomes include:

Improved Infrastructure – Enhanced network and platform for machine learning workloads, ensuring the resilient protection of sensitive healthcare data from hospitals for HIPAA and HITRUST compliance.
Enhanced Time to Development – Increased developer productivity through automated checks for code scanning, quality control for deployment workflows, and reduced go-live time for newly onboarded users by automating infrastructure processes.
Reduced Latency – Optimized model serving infrastructure for cloud deployment to efficiently handle multiple requests, resulting in improved performance, reduced latency, and greater scalability.

Utilizing Triton Inference Server and OCI resources, Quantiphi helped AvaSure to improve operational efficiency and set a new standard for AI deployment in the healthcare industry, driving meaningful change and improving patient outcomes.