The Replication Crisis in Psychology

//The Mainstream Narrative

The standard story presents the replication crisis as a healthy corrective: science self-examined, found problems with statistical practices (p-hacking, HARKing, underpowered studies), and is now reforming through pre-registration, open data, and larger sample sizes. Major replication projects like the Reproducibility Project: Psychology (2015) found only 36-39% of studies successfully replicated, but institutions emphasize this proves science works.

//Under-Reported Dimensions

The career destruction and institutional resistance remain largely hidden. Early-career researchers who conducted replication attempts faced professional retaliation—senior authors whose work failed to replicate publicly attacked the replicators, calling their methods flawed while defending original findings. Journals systematically refused to publish null results for decades, creating a "file drawer problem" where 95% of published psychology findings showed positive results—statistically impossible if hypotheses were genuinely tested. Pharmaceutical companies privately knew about these issues since the 1990s; internal industry replication efforts found 75-90% failure rates for published academic findings, but kept this confidential to avoid undermining drug development partnerships.

//Credible Dissenting Voices

Not all failures indicate fraud or incompetence. Critics like Daniel Kahneman admitted his priming research couldn't replicate, yet defenders like Susan Fiske called replication advocates "methodological terrorists." Statistician Andrew Gelman exposed that sample sizes of 20-30 participants—standard in social psychology—provide nearly zero reliable information about effects. Some argue context-dependency (cultural shifts, historical moments) means exact replication is philosophically impossible for human behavior research.

//Follow the Money

Grant agencies funded splashy, novel findings over unglamorous replications. Universities promoted researchers based on publication counts in high-impact journals that favored counterintuitive results. The "publish or perish" system created perverse incentives to chase statistical significance rather than truth. Textbook publishers continue selling books citing non-replicable findings because curriculum overhaul is expensive.

//Open Questions

How many clinical interventions, educational policies, and business practices rest on non-replicable research? Should there be legal liability for researchers whose irreplicable work influenced harmful policies? Can qualitative/interpretive psychology offer more reliable insights than quantitative approaches?