Artificial intelligence integration in healthcare: perspectives and trends in a survey of U.S. health system leaders

Abstract

Abstract Background The healthcare sector is rapidly integrating artificial intelligence-derived predictive models (AIDPM) to enhance clinical decision support, operational efficiency, and patient experiences. However, research on management strategies for AIDPM acquisition, deployment, and governance remains limited. This study examines changes in AIDPM integration and governance since 2021, with a particular focus on large language models and health equity considerations. Results Our survey of health system leaders achieved a 49% response rate (32/65). While 84% of institutions reported using AIDPM in clinical practice, only 53% had established dedicated teams for these models. Compared to 2021, there was a significant increase in representation from experts in clinical informatics, operations, and quality improvement on AIDPM teams. Most organizations (41%) primarily purchased AIDPM from external vendors. Support for integrating large language models into healthcare practices was unanimous among respondents. The principal obstacles to AIDPM adoption included regulatory concerns, data security, workflow integration, and clinician acceptance. A large majority (72%) of respondents supported government regulation of AI in healthcare. While 76% of organizations reported having a team member dedicated to health equity, ethicists and diversity leaders were underrepresented on AIDPM teams (18%). Organizations reported various efforts to promote health equity, but involvement of frontline clinicians in AIDPM development and its impact on health equity was significantly less common. Conclusions Clinical adoption of AIDPM faces challenges due to the absence of established best practices. Health system leaders strongly support federal regulations for AI in healthcare. These regulations could provide quality and safety standards. The study highlights the need for developing evaluation guidelines, especially for large language models. It also reveals a lack of uniform involvement of frontline clinicians and equity experts in AIDPM governance. Their involvement could increase adoption and trust of these new AI tools. Future research should assess healthcare systems' adherence to emerging regulations and best practice frameworks. This research should emphasize patient safety and health equity. These findings underscore the urgent need for a comprehensive roadmap. This roadmap would guide the responsible implementation of AIDPM in healthcare settings.

Keywords

• Prediction models
• Artificial intelligence
• AI implementation
• Machine learning
• Large language models
• Health systems