Assessment of Anaesthesia Teams’ Non-Technical Skills in Clinical Practice before and after Simulation-Based Team Training: A Quasiexperimental Study

Abstract

Background. In situ simulation-based team training of non-technical skills is considered an important initiative for preventing adverse events caused by poor teamwork among healthcare personnel. This study aimed to assess the non-technical skills of anaesthesia personnel before and after in situ simulation-based team training in a clinical setting. Methods. The study was conducted from October 2020 to June 2021 using a quasiexperimental before and after design based on video-recorded observations and ratings of anaesthesia teams’ non-technical skills during anaesthesia induction in the operating room before and shortly after in situ simulation-based team training. Anaesthesia personnel were divided into 20 teams and video recorded during anaesthesia induction. The Anaesthetists’ Non-technical Skills (ANTS) system was used to score the teams’ non-technical skills. A paired-sample t-test was used to assess the impact of the intervention on the anaesthesia teams’ scores on the various ANTS categories. Interrater agreement between the two ANTS raters was assessed using weighted kappa. Results. At the category level, the overall scores had a statistically significant increase in performance after simulation-based team training (3.48 vs. 3.71; p<0.001). Furthermore, scores of five of the 15 elements were significantly different. Interrater agreement revealed moderate agreement between the two raters (weighted kappa = 0.51, p value <0.001). Conclusion. The anaesthesia teams’ increased non-technical skills after simulation-based team training may indicate the transfer of knowledge from training to clinical practice. The moderate agreement between the raters could be attributed to the subjective nature of the evaluation procedure. The ANTS was originally used as an individual assessment tool; however, this study has demonstrated its potential as a team assessment tool.