Concurrence's Governance Framework Enhances Safety in Clinical AI Deployment
With AI usage in healthcare surging fivefold, Concurrence's governance framework for clinical AI ensures data reliability and compliance, processing over 100 billion tokens monthly to improve patient care.
Key Facts
- Concurrence processes 1.2 trillion tokens annually, indicating rapid AI adoption in healthcare.
- 5x growth in token volume reveals unexpected demand for reliable clinical AI solutions.
- Rigorous testing with 7x simulation traffic shows commitment to safety and quality in AI deployment.
- Centralized governance via Unity Gateway enhances compliance, reducing potential legal vulnerabilities.
- Unified data architecture lowers incremental costs, supporting scalable AI workflows in healthcare.
Summary
Summary
Concurrence, a healthcare AI company, faced the challenge of managing vast amounts of patient data while ensuring compliance and reliability in clinical workflows. By implementing a unified data and AI foundation on Databricks and utilizing Unity Gateway for governance, Concurrence successfully scaled its operations to process approximately 1.2 trillion input tokens annually, significantly enhancing the efficiency and reliability of its AI agents.
Background
Concurrence operates in the healthcare industry, focusing on building clinical AI agents that support patient and provider workflows. Before deploying its new architecture, the company dealt with inconsistent patient data across various systems, which complicated care coordination and compliance efforts.
Challenge
The specific challenge was to create a reliable AI system that could manage and govern patient data effectively while adhering to stringent compliance requirements, such as HIPAA. The existing data management approach was insufficient for the scale and complexity of the clinical workflows.
Solution
Concurrence implemented a comprehensive architecture on Databricks, utilizing Lakebase for operational state management, Unity Catalog for data governance, and Unity Gateway for centralized AI access. This setup allowed the company to record patient information as immutable events, ensuring a consistent view of patient data. The architecture also included rigorous testing protocols for AI agents using simulated patient data before deployment.
Results
Concurrence's new system processes approximately 100.8 billion input tokens and 11.2 million LLM calls every 30 days, leading to an annualized run rate of roughly 1.2 trillion input tokens. The monthly token volume has grown about 5x from its baseline in late 2025 to July 2026. The architecture has enabled the company to retire its previous prompt-log store and reverse-ETL jobs, streamlining operations.
Key Insights
A unified data and AI foundation can significantly enhance the reliability and efficiency of AI systems in high-stakes environments like healthcare. Immutable data records and rigorous testing protocols are essential for maintaining compliance and ensuring the accuracy of AI outputs.
Customer Testimonial
No direct quote is available from the source material.
Entities Mentioned
Companies
Products
Technologies
People
Key Concepts
Definitions
- AI governance
- The framework and processes that ensure AI systems operate within compliance and ethical guidelines.
- immutable event history
- A record-keeping method where new information is added as events rather than overwriting existing data.
- patient state
- The current understanding of a patient's information, derived from a history of immutable events.
- coding agents
- AI systems used by developers to assist in coding tasks and operations.
- Unity Gateway
- A centralized access point for managing AI model and tool traffic in a governed manner.
Use Cases
- →Care gap outreach
- →Medication adherence outreach
- →Simulated patient testing for AI agents
- →Real-time patient inference
- →Batch AI workloads management
- →Governed coding agent operations
Frequently Asked Questions
What is the role of Concurrence in healthcare AI?
Concurrence builds clinical AI agents that assist in patient care coordination, ensuring reliable data and compliance in high-stakes environments.
How does Concurrence ensure data reliability?
Concurrence uses an immutable event history to track changes in patient information, allowing for a consistent view of patient data while preserving its provenance.
What compliance standards does Concurrence adhere to?
Concurrence is compliant with HIPAA, GDPR, and SOC 2, and is working towards HITRUST and ISO 27001/42001 certifications.
How does Unity Gateway enhance AI governance?
Unity Gateway centralizes access to AI models and tools, ensuring that all requests are tracked and managed according to compliance requirements.
What is the significance of testing AI agents before deployment?
Testing AI agents against simulated patients allows Concurrence to evaluate their performance and safety without risking real patient data, ensuring higher reliability.