Transparency considerations for describing statistical analyses in research

Abstract

Researchers who use the results of statistical analyses to draw conclusions about collected data must write a statistical analysis section in their manuscript. Describing statistical analyses in precise detail is as important as presenting the dosages of drugs and methodology of interventions. It is also essential for scientific accuracy and transparency in scientific research. We evaluated the quality of the statistical analysis sections of clinical research articles published in the Korean Journal of Anesthesiology between February 2020 and February 2021. Using a Likert scale where 1, 2, and 3 represented “not described at all,” “partially described,” and “fully described,” respectively, the following 6 items were assessed: 1) stating of the statistical analysis methods used, 2) rationale for and detailed description of the statistical analysis methods used, 3) parameters derived from the statistical analyses, 4) type and version of the statistical software package used, 5) significance level, and 6) sidedness of the test (one-sided vs. two-sided). The first 3 items evaluate issues directly related to the statistical analysis methods used and last 3 are indirectly related items. In all the included articles, the statistical analysis methods used were stated (score of 3). However, only 4 articles (12.9%) fully described the sidedness of the test (score of 3). Authors tend not to describe the sidedness of statistical analysis tests in the methodology section of clinical research articles. It is essential that the sidedness be described in research studies.

Keywords

• data analysis
• probability
• research
• software
• statistical data interpretation
• statistics