Investigating change across time in prevalence or association: the challenges of cross-study comparative research and possible solutions

Abstract

Abstract Cross-study research initiatives to understand change across time are an increasingly prominent component of social and health sciences, yet they present considerable practical, analytical and conceptual challenges. First, we discuss the key challenges to comparative research as a basis for detecting societal change, as well as possible solutions. We focus on studies which investigate changes across time in outcome occurrence or the magnitude and/or direction of associations. We discuss the use and importance of such research, study inclusion, sources of bias and mitigation, and interpretation. Second, we propose a structured framework (a checklist) that is intended to provide guidance for future authors and reviewers. Third, we outline a new open-access teaching resource that offers detailed instruction and reusable analytical syntax to guide newcomers on techniques for conducting comparative analysis and data visualisation (in both R and Stata formats).

Keywords

• Comparative research
• Time trends
• Cross-study analysis
• Measurement
• Missing data