Results show a strong preference for AI combined with clinician oversight; concerns about “black box” risks persist
SAN FRANCISCO, December 16, 2025 /PRNewswire/ — Hospitals and health systems overwhelmingly prefer artificial intelligence (AI) models that combine technology and clinical expertise, according to the results of a new survey released today by Carta Healththe leading provider of AI-based clinical data abstraction solutions.
November 2025 results AI in hospitals and health systems Market research reveals healthcare leaders want AI to empower clinicians, not replace them. Each major discovery confirms that “hybrid intelligence” is the superior and preferred model because it combines technology with human and clinical expertise.
The investigation, conducted by Reaction datasurveyed health system leaders on their perceptions of the types of AI models, barriers to adoption, and the role of human oversight in clinical workflows. Respondents consistently indicated that standalone, black-box AI is risky and insufficient for high-stakes clinical environments, while AI combined with expert human validation is considered safer, more accurate, and more effective.
The majority cite the risks of autonomous AI; Human surveillance considered essential
Respondents expressed strong skepticism toward fully autonomous AI.
- 62.5% of respondents identified “misinterpretation of data” as the top risk when AI operates without human oversight – a concern with direct implications for patient safety and data reliability.
- So far, only 12.5% of organizations said autonomous AI brought the most value to their work.
On the other hand,
- 75% of respondents rely on “human validation” to ensure AI results are clinically relevant and trustworthy.
- Another 75% called clinician involvement in the design and deployment of AI “critically important,” underscoring the expectation that AI must work. with clinicians, not independently of them.
Hybrid intelligence emerges as the superior and preferred model
Fifty percent of respondents also clearly stated that AI “should augment human decision-making,” compared to a minority who view it as a task replacement tool.
“The survey clearly shows what we have long believed: good AI is not enough,” said Brent Dover, CEO of Carta Healthcare. “Healthcare leaders aren’t looking for a magic switch to automate health care. They want a force multiplier: AI that respects clinical expertise, demands human validation, and integrates seamlessly with existing workflows. The winning strategy is to build a better team where AI provides the speed and scale, while humans provide the judgment and care.
Survey methodology
In November 2025, a national online survey was conducted by Reaction Data, a market research company specializing in health information technology. Respondents chose to participate based on their role and expertise. Only nuanced responses were included.
About Carta Healthcare
At Carta Healthcare, we believe that high-quality data is the foundation for better healthcare outcomes. Traditional methods of clinical data abstraction are labor-intensive, time-consuming, and costly. Our hybrid intelligence approach combines advanced AI with expert clinicians to deliver accurate, actionable data, reduce costs and improve efficiency for hospitals and health systems nationwide. Recognized with awards such as the Merit Award, Pinnacle Award and BIG Innovation Awards, Carta Healthcare is redefining the future of healthcare data management. Learn more about https://www.carta.healthcare/.
Media contact:
Katlyn Nesvold
Amendola Communications for Carta Healthcare
(email protected)
SOURCE Carta Health
