Validation of a COVID-19 mental health and wellness survey questionnaire

Abstract

Abstract Background and aim COVID-19 affected mental health and wellbeing. Research is needed to assess its impact using validated tools. The study assessed the content validity, reliability and dimensionality of a multidimensional tool for assessing the mental health and wellbeing of adults. Methods An online questionnaire collected data in the second half of 2020 from adults in different countries. The questionnaire included nine sections assessing: COVID-19 experience and sociodemographic profile; health and memory; pandemic stress (pandemic stress index, PSI); financial and lifestyle impact; social support; post-traumatic stress disorder (PTSD); coping strategies; self-care and HIV profile over 57 questions. Content validity was assessed (content validity index, CVI) and participants evaluated the test-retest reliability (Kappa statistic and intra-class correlation coefficient, ICC). Internal consistency of scales was assessed (Cronbach α). The dimensionality of the PSI sections and self-care strategies was assessed by multiple correspondence analysis (MCA) using all responses and SPSS. For qualitative validation, we used a semi-structured interview and NVivo was used for coding and thematic analysis. Results The overall CVI = 0.83 with lower values for the memory items. Cronbach α for the memory items = 0.94 and ICC = 0.71. Cronbach α for PTSD items was 0.93 and ICC = 0.89. Test-retest scores varied by section. The 2-dimensions solution of MCA for the PSI behavior section explained 33.6% (precautionary measures dimension), 11.4% (response to impact dimension) and overall variance = 45%. The 2-dimensions of the PSI psychosocial impact explained 23.5% (psychosocial impact of the pandemic dimension), 8.3% (psychosocial impact of the precautionary measures of the pandemic dimension) and overall variance = 31.8%. The 2-dimensions of self-care explained 32.9% (dimension of self-care strategies by people who prefer to stay at home and avoid others), 9% (dimension of self-care strategies by outward-going people) and overall variance = 41.9%. Qualitative analysis showed that participants agreed that the multidimensional assessment assessed the effect of the pandemic and that it was better suited to the well-educated. Conclusion The questionnaire has good content validity and can be used to assess the impact of the pandemic in cross-sectional studies especially as individual items. The PSI and self-care strategies need revision to ensure the inclusion of items with strong discrimination.

Keywords

• Validity
• Reliability
• Questionnaire
• COVID-19
• Stress
• Multiple correspondence analysis