Prospective International Pilot Study Evaluating the Efficacy of a Self-Guided Contouring Teaching Module With Integrated Feedback for Transitioning From 2D to 3D Treatment Planning

Abstract

PURPOSE: Transitioning from two-dimensional to three-dimensional treatment planning requires developing contouring skills. Contouring atlases are excellent resources, but they do not provide users active feedback. Developing countries may not have many radiation oncologists experienced in three-dimensional planning to provide training. We sought to develop a standardized self-guided educational module with integrated feedback to teach contouring skills. METHODS AND MATERIALS: All 18 oncology residents at Black Lion Hospital/Addis Ababa University in Ethiopia were trained to contour the level II lymph node station. Residents took a baseline pretest quiz, survey, and contouring evaluation. Residents then watched an instructional contouring lecture and performed three additional cases with integrated feedback by comparing their contours to gold-standard contours. Residents then took a post-training quiz, survey, and contouring evaluation. Paired t tests and analysis of variance were used for analysis. RESULTS: Before training, the average number of total cases ever contoured was 2.4 and the average number of head and neck cases contoured was 0.5. Comfort with contouring improved from being “not at all comfortable” to “quite comfortable” after the 3-hour training (P < .001). The standard deviation between the resident contours and gold standard improved from 72.6 cm3 (pretest) to 7.4 cm3 (post-test). The average percentage overlap with the gold-standard contours and Dice similarity coefficient improved with each case performed, from 27.7% and 0.26 (pretest) to 80.1% and 0.77 (post-test), respectively (P < .001). After training, 16 of 18 (88.9%) residents produced a Dice similarity coefficient greater than 0.7, the threshold generally accepted for excellent agreement. CONCLUSION: This self-guided teaching module was an effective tool for developing level II lymph node contouring skills by providing active feedback and resulted in improved user confidence and accuracy compared with a gold standard. This module can be expanded to other disease sites and countries to further facilitate transitioning to three-dimensional treatment planning in developing countries.