562 AI Translation Advisory Board: Mastering team science to facilitate implementation of AI into clinical practice

Abstract

OBJECTIVES/GOALS: Healthcare sectors are rushing to develop AI models. Yet, a dearth of coordinated practices leaves many teams struggling to implement models into practice. The Enterprise AI Translation Advisory Board uses across-disciplinary team to facilitate AI translation. METHODS/STUDY POPULATION: The Mayo Clinic Enterprise AI Translation Advisory Board was established to assess AI solutions lever aging cross-disciplinary team science to accelerate AI innovation and translation. The 23-member board reflects expertise in data science, qualitative research, user experience, IT, human factors, informatics, regulatory compliance,ethics, and clinical care, with members spanning thought leadership, decision-making, and clinical practice. Taking an approach of respectful communication, transparency, scientific debate, and open discussion, the Board has consulted onover two dozen projects at various stages of the AI life cycle. RESULTS/ANTICIPATED RESULTS: Common issues identified for projects earlier in the AI life cycle, sometimes fatal but often address able once identified, include a lack of buy-in from potential product users, a lack of planningabout integration into clinical workflow, inadequately labeled data, and attempting to use machine learning when what is desired is really a causal model for intervening. Recommendations for projects later in the AI life cycle include details of a testing plan (silent evaluation, pragmatic clinical trials), advice about clinical integration, both post-hoc and on going auditing for performance disparities, and planning for regulatory clearance. DISCUSSION/SIGNIFICANCE: Advising is more valuable for projects at the ideation phase, when multi disciplinary interrogation can identify weaknesses. But at all phases, projects have gaps related to a lack of specific disciplinary expertise. A multi disciplinary cluster like the AI Translation Advisory Board seeks to address these gaps.