Risk Management and Healthcare Policy (Jun 2022)

Bias and Reporting Quality of Clinical Prognostic Models for Idiopathic Pulmonary Fibrosis: A Cross-Sectional Study

  • Di J,
  • Li X,
  • Yang J,
  • Li L,
  • Yu X

Journal volume & issue
Vol. Volume 15
pp. 1189 – 1201

Abstract

Read online

Jiaqi Di,1 Xuanlin Li,1 Jingjing Yang,1 Luguang Li,2 Xueqing Yu2 1Co-Construction Collaborative Innovation Center for Chinese Medicine and Respiratory Diseases by Henan & Education Ministry of P.R, Henna University of Chinese Medicine, Zhengzhou, 450046, People’s Republic of China; 2Department of Respiratory Diseases, The First Affiliated Hospital of Henan University of Chinese Medicine, Zhengzhou, Henan, 450000, People’s Republic of ChinaCorrespondence: Xueqing Yu, Email [email protected]: This study aims to evaluate the risk of bias (ROB) and reporting quality of idiopathic pulmonary fibrosis (IPF) prediction models by assessing characteristics of these models.Methods: The development and/or validation of IPF prognostic models were identified via an electronic search of PubMed, Embase, and Web of Science (from inception to 12 August, 2021). Two researchers independently assessed the risk of bias (ROB) and reporting quality of IPF prediction models based on the Prediction model Risk Of Bias Assessment Tool (PROBAST) and Transparent Reporting of a multivariable prognostic model for Individual Prognosis or Diagnosis (TRIPOD) checklist.Results: Twenty prognostic model studies for IPF were included, including 7 (35%) model development and external validation studies, 8 (40%) development studies, and 5 (25%) external validation studies. According to PROBAST, all studies were appraised with high ROB, because of deficient reporting in the domains of participants (45.0%) and analysis (67.3%), and at least 55% studies were susceptible to 4 of 20 sources of bias. For the reporting quality, none of them completely adhered to the TRIPOD checklist, with the lowest mean reporting score for the methods and results domains (46.6% and 44.7%). For specific items, eight sub-items had a reporting rate ≥ 80% and adhered to the TRIPOD checklist, and nine sub-items had a very poor reporting rate, less than 30%.Conclusion: Studies adhering to PROBAST and TRIPOD checklists are recommended in the future. The reproducibility and transparency can be improved when studies completely adhere to PROBAST and TRIPOD checklists.Keywords: idiopathic pulmonary fibrosis, PROBAST, reporting quality, risk of bias, TRIPOD

Keywords