Inference in economic experiments

Abstract

Replication crisis and debates about p-values have raised doubts about what we can statistically infer from research findings, both in experimental and observational studies. With a view to the ongoing debate on inferential errors, this paper systematizes and discusses experimental designs with regard to the inferences that can and – perhaps more important – that cannot be made from particular designs.

Keywords

• economic experiments
• ceteris paribus
• confounders
• control
• inference
• internal/external validity
• randomization
• random sampling
• superpopulation
• b41
• c18
• c90