Assessing technical skill in ankle fracture surgery from the postoperative radiograph: pilot development and validation of a final product analysis core outcome set

Abstract

Aims: To identify a core outcome set of postoperative radiographic measurements to assess technical skill in ankle fracture open reduction internal fixation (ORIF), and to validate these against Van der Vleuten’s criteria for effective assessment. Methods: An e-Delphi exercise was undertaken at a major trauma centre (n = 39) to identify relevant parameters. Feasibility was tested by two authors. Reliability and validity was tested using postoperative radiographs of ankle fracture operations performed by trainees enrolled in an educational trial (IRCTN 20431944). To determine construct validity, trainees were divided into novice (performed 0.8), and inter-rater reliability was substantial for LMD, MMD, TCA, and moderate (ICC 0.61 to 0.80) for MCS and TFCS. Assessment was time efficient compared to PBA. Conclusion: Assessment of technical skill in ankle fracture surgery using the first postoperative radiograph satisfies the tested Van der Vleuten’s utility criteria for effective assessment. 'Final product analysis' assessment may be useful to assess skill transfer in the simulation-based research setting. Cite this article: Bone Jt Open 2022;3(6):502–509.

Keywords

• surgical education
• training
• assessment
• outcome validation
• postoperative radiographs
• ankle fracture surgery
• ankle fractures
• ankle
• open reduction internal fixation (orif)
• mcs
• intraclass correlation coefficient (icc)
• trauma
• radiographic measurements
• global rating scale