Zhongguo quanke yixue (Mar 2022)

Development，Reliability and Validity of the Health Management Service Skills Training Evaluation Scale for Rural Doctors

  • LIAO Kang, WANG Nameng, FENG Mei, WANG Xiaoxu, LI Liqi

DOI
https://doi.org/10.12114/j.issn.1007-9572.2022.00.003
Journal volume & issue
Vol. 25, no. 07
pp. 882 – 887

Abstract

Read online

BackgroundFew studies have evaluated the effectiveness of health management services sills trainings for rural doctors, and there is a lack of effective evaluation toolsin China.ObjectiveTo develop the Health Management Service Skills Training Evaluation Scale for Rural Doctors (HMSSTESRD) , and test its reliability and validity.MethodsThe initial version of HMSSTESRD was developed using the framework of Kirkpatrick model, then was revised using expert consultation and group discussion, and was pretested using a survey with a sample of 100 cases conducted between May to June, 2021. The scale was further revised according to the survey, and analyzed using reliability analysis and exploratory factor analysis, then the formal version was determined. In July 2021, the formal scale was retested in a sample (n=306) , and was revised according to the test results, and was subjected to confirmatory factor analysis, homogeneous reliability analysis, composite reliability analysis, discriminant validity analysis, and structural validity analysis.ResultsThe formal scale consists of 15 entries in 4 dimensions: reaction, learning, behavior, and results. The KMO index was 0.847, Bartlett's test of sphericity was significant (χ2=1 862.826, P<0.05) , and the percentage of explained total variance in exploratory factor analysis was 87.575%. The results of the confirmatory factor analysis were χ2/df=3.906, RMSEA=0.098, CFI=0.961, IFI=0.961, and NFI=0.948, indicating that the model fit was basically good. When it comes to the formal scale, the Cronbach's α was 0.967. The Cronbach's α for each dimension (reaction, learning, behavior, and results) was 0.962, 0.958, 0.971, and 0.919, respectively. And the CR values for these dimensions were 0.963, 0.958, 0.971, and 0.919, respectively. The arithmetic square root of AVE was greater than the correlation coefficient between the factors. Theinter-dimension correlation coefficients were 0.538 to 0.842, and the dimension-scalecorrelation coefficients were 0.754 to 0.934.ConclusionThe HMSSTESRD developed by us has been proved to have good reliability and validity, which could be used as an effective tool for assessingtheeffectiveness of health management service skills trainingsfor rural doctors.

Keywords