Does type of funding affect reporting in network meta-analysis? A scoping review of network meta-analyses

Abstract

Abstract Background Evidence has shown that private industry-sponsored randomized controlled trials (RCTs) and meta-analyses are more likely to report intervention-favourable results compared with other sources of funding. However, this has not been assessed in network meta-analyses (NMAs). Objectives To (a) explore the recommendation rate of industry-sponsored NMAs on their company’s intervention, and (b) assess reporting in NMAs of pharmacologic interventions according to their funding type. Methods Design: Scoping review of published NMAs with RCTs. Information Sources: We used a pre-existing NMA database including 1,144 articles from MEDLINE, EMBASE and Cochrane Database of Systematic Reviews, published between January 2013 and July 2018. Study Selection: NMAs with transparent funding information and comparing pharmacologic interventions with/without placebo. Synthesis: We captured whether NMAs recommended their own or another company’s intervention, classified NMAs according to their primary outcome findings (i.e., statistical significance and direction of effect), and according to the overall reported conclusion. We assessed reporting using the Preferred Reporting Items for Systematic Reviews and Meta-Analysis extension to NMA (PRISMA-NMA) 32-item checklist. We matched and compared industry with non-industry NMAs having the same research question, disease, primary outcome, and pharmacologic intervention against placebo/control. Results We retrieved 658 NMAs, which reported a median of 23 items in the PRISMA-NMA checklist (interquartile range [IQR]: 21–26). NMAs were categorized as 314 publicly-sponsored (PRISMA-NMA median 24.5, IQR 22–27), 208 non-sponsored (PRISMA-NMA median 23, IQR 20–25), and 136 industry/mixed-sponsored NMAs (PRISMA-NMA median 21, IQR 19–24). Most industry-sponsored NMAs recommended their own manufactured drug (92%), suggested a statistically significant positive treatment-effect for their drug (82%), and reported an overall positive conclusion (92%). Our matched NMAs (25 industry vs 25 non-industry) indicated that industry-sponsored NMAs had favourable conclusions more often (100% vs 80%) and were associated with larger (but not statistically significantly different) efficacy effect sizes (in 61% of NMAs) compared with non–industry-sponsored NMAs. Conclusions Differences in completeness of reporting and author characteristics were apparent among NMAs with different types of funding. Publicly-sponsored NMAs had the best reporting and published their findings in higher impact-factor journals. Knowledge users should be mindful of this potential funding bias in NMAs.

Keywords

• Sponsorship
• Funding bias
• Industry-funding
• Network meta-analysis
• Multiple treatment meta-analysis