The Development of Summative Assessment Index System of Resident Standardized Training in General Practice Based on Post Competence

Abstract

Background Competency development is the core of residency training in general practice, as well as the key to training qualified general practitioners. Summative assessment can evaluate overall training outcome and the attainment of general practitioner competencies. Summative assessment in general practice is still in developing in China, and its relevance to competencies is relatively weak. Objective To develop competency based summative assessment indicator framework of residency training in general practice, and to provide reference for improving the summative assessment system in China. Methods From 2023-04-25 to 30, 32 experts from 10 provinces, including Beijing, Shanghai, Hebei, Jiangsu, Zhejiang, Liaoning, Inner Mongolia Autonomous Region, Hainan, Ningxia Hui Autonomous Region and Sichuan Province were invited to participate in Delphi Expert Survey. The indicator framework of summative assessment was established through literature review and Delphi expert survey. The weight of indicators was determined by multiplicative model. Results In both the first and second rounds of expert survey, 32 questionnaires were issued and 32 were recovered, which were all valid. The positive coefficient was 100.0%, the authority coefficient was > 0.8, the importance coordination coefficient of indicators at all levels respectively was 0.382, 0.284, 0.265, and the feasibility coordination coefficient was 0.415, 0.359, 0.332. The final summative assessment indicator framework consisted of 6 first-tier indicators, 24 second-tier indicators and 50 third-tier indicators. The first-tier indicators include application of clinical professional knowledge and skills, the ability to take care of the family, the ability to provide basic public health services, the ability to communicate, cooperate and coordinate, humanistic ability and professionalism, clinical teaching and scientific research ability, and the weights were 0.505, 0.061, 0.109, 0.134, 0.125 and 0.066, respectively. Conclusion This study preliminarily explored and constructed competency based summative assessment indicator framework of residency training in general practice, which provides reference for further research on the contents of summative assessment and on the improvement of summative assessment system in China. The framework is important for improving the quality of residency training and competencies of general practitioners.

Keywords

• general practitioners|educational measurement|post competence|residency training|summative assessment|evaluation