In this episode of Straight Out of Health IT, David Hilderbrand, Chief Commercial Officer at Ferrum Health, joins Christopher Kunney to discuss the rapid rise of clinical AI, medical imaging AI consolidation, and the growing need for enterprise-level governance. He explains why health systems are no longer just asking which AI tools to buy, but how to monitor, manage, and understand the tools already running across their organizations. As AI enters through devices, platforms, service lines, and vendor relationships, CIOs and clinical leaders are facing a new kind of operational complexity. The conversation explores why effective AI oversight has become essential as adoption accelerates across healthcare.

David breaks down the difference between AI committees, analytics, telemetry, and true governance. He explains that governance is not simply about knowing whether an algorithm is turned on, but about understanding how it behaves in clinical care and how it performs across different patient populations. Without that level of visibility, health systems risk overlooking issues such as bias, model drift, inconsistent performance, and patient impact. He argues that meaningful governance is critical to ensuring AI delivers safe, reliable, and measurable clinical value.

David also shares how Ferrum Health approaches clinical AI through platforming, observability, and neutral model monitoring. Rather than recommending which AI tools organizations should adopt, Ferrum helps health systems gain visibility into their entire AI portfolio so they can make informed decisions about expanding, replacing, or retiring algorithms. The discussion also covers measuring ROI, recognizing the costs of underperforming AI models, and the importance of early disease detection. Hilderbrand concludes by explaining why AI governance should remain independent from vendor bias to support better long-term clinical and operational outcomes.

Tune in to hear why clinical AI governance is becoming essential infrastructure for health systems, and why the future of healthcare AI depends on visibility, accountability, and trust.