Three Suggestions to Support Ongoing Replication Efforts: A Checklist, Visual Comparison, and Rating Scale

Abstract

We propose three practical suggestions that might be used in tandem to help address enduring replication challenges: (1) a methodology checklist to increase awareness of potentially overlooked variables and scaffold the design of replication attempts, (2) a means of facilitating visual side-by-side comparisons of reference and replication methodologies to increase replication fidelity, and (3) a broader methodology fidelity rating system to capture the nuance associated with direct replication. Incorporating these suggestions into replication efforts could facilitate improved coordination of multi-site replication attempts and offer a standardized means of assessing methodological fidelity for replication submissions and data review.

Keywords

• Direct and conceptual replication
• Methodological fidelity
• Methodology checklist
• Methodological visual side-by-side comparison
• Methodological rating scale