Disruption of trauma research: an analysis of the top cited versus disruptive trauma research publications

Abstract

Introduction The analysis of surgical research using bibliometric measures has become increasingly prevalent. Absolute citation counts (CC) or indices are commonly used markers of research quality but may not adequately capture the most impactful research. A novel scoring system, the disruptive score (DS) has been found to identity academic work that either changes paradigms (disruptive (DIS) work) or entrenches ideas (developmental (DEV) work). We sought to analyze the most DIS and DEV versus most cited research in civilian trauma.Methods The top papers by DS and by CC from trauma and surgery journals were identified via a professional literature search. The identified publications were then linked to the National Institutes of Health iCite tool to quantify total CC and related metrics. The top 100 DIS and DEV publications by DS were analyzed based on the area of focus, citation, and perceived clinical impact, and compared with the top 100 papers by CC.Results 32 293 articles published between 1954 and 2014 were identified. The most common publication location of selected articles was published in Journal of Trauma (31%). Retrospective reviews (73%) were common in DIS (73%) and top CC (67%) papers, while DEV papers were frequently case reports (49%). Only 1 publication was identified in the top 100 DIS and top 100 CC lists. There was no significant correlation between CC and DS among the top 100 DIS papers (r=0.02; p=0.85), and only a weak correlation between CC and DS score (r=0.21; p<0.05) among the top 100 DEV papers.Conclusion The disruption score identifies a unique subset of trauma academia. The most DIS trauma literature is highly distinct and has little overlap with top trauma publications identified by standard CC metrics, with no significant correlation between the CC and DS.Level of evidence Level IV.