Advances in Medical Education and Practice (Jul 2023)
The Ethiopian Anesthetist Licensing Examination and Associated Improvement in in-School Student Performance: A Retrospective Study
Abstract
Yohannes Molla Asemu,1,2 Tegbar Yigzaw,1 Firew Ayalew,1 Leulayehu Akalu,3,4 Fedde Scheele,2,5,6 Thomas van den Akker2,7 1Health Workforce Improvement Program, Jhpiego, an Affiliate of Johns Hopkins University, Ethiopia Country Office, Addis Ababa, Ethiopia; 2Athena Institute, Faculty of Science, Vrije Universiteit Amsterdam, Amsterdam, the Netherlands; 3Ethiopian Association of Anesthetists (EAA), Addis Ababa, Ethiopia; 4School of Anesthesia, Addis Ababa University, Addis Ababa, Ethiopia; 5Department of Obstetrics and Gynecology, OLVG Teaching Hospital, Amsterdam, the Netherlands; 6Department of Obstetrics and Gynecology, Amsterdam University Medical Center (AUMC), Amsterdam, the Netherlands; 7Department of Obstetrics and Gynecology, Leiden University Medical Centre (LUMC), Leiden, the NetherlandsCorrespondence: Yohannes Molla Asemu, Jhpiego, an Affiliate of Johns Hopkins University, Ethiopia Country Office, Kirkos Sub-City, Kebele 02/03, House 693, Wollo Sefer, Addis Ababa, Ethiopia, Tel +251 911384046, Email [email protected]: Ethiopia introduced a national licensing examination (NLE) in response to growing concerns about the competence of graduates and the quality of education. This study aimed to assess the associated in-school student performance changes in anesthetist training programs following NLE implementation.Methods: Academic records of 1493 graduate anesthetists were retrospectively obtained from eight universities before (n=932) and after (n=561) NLE implementation. Four universities were first-generation (oldest), three were second-generation, and one was third-generation (newest). We compared the yearly (Y1 to Y4) and cumulative grade point averages (GPA) to assess if there were in-school student performance differences between the two periods. The Kruskal–Wallis and Mann–Whitney U-tests were used to compare groups. Results are presented as a median, interquartile range, a 95% confidence interval (CI) for median differences, and Cohen’s r effect size.Results: Overall, there was a small to moderate improvement in student academic performance following NLE implementation. However, the statistically significant differences were limited to first-generation university students and those entering directly from high school. We found considerable positive differences in all five performance measures in first-generation university students, with Year-1 GPA and cumulative GPA measurements exhibiting large effect sizes (Cohen’s r = 0.96 and 0.79, respectively, p < 0.005). Those entering from high school demonstrated significant differences in four of five performance measures, with the largest positive gains on the year-1 GPA (median before [n=765] and after [n=480]: 3.11– 3.30, 95% CI (0.09, 0.22), r=0.46, p < 0.005)). Second- and third-generation university students showed no significant differences, while nurse entrants exhibited a significant difference in their Y2GPA scores only with an actual drop in performance.Conclusion: The Ethiopian anesthetist NLE is associated with an overall modest in-school academic performance improvement, supporting its use. The stagnant or declining performance among nurse entrants and the newest (second and third) generation university students deserve further scrutiny.Keywords: anesthesia, anesthetist, associate clinician, non-physician, licensing examination
