The Replication Crisis in Psychology

The replication crisis emerged when researchers discovered that many influential psychology studies—some cited thousands of times—could not be reproduced by independent scientists. This sparked fierce debate about scientific rigor, publication bias, career incentives, and whether decades of accepted findings are actually valid. Critics argue the field's methods are fundamentally flawed, while defenders claim normal scientific correction is being sensationalized.

• documentDOC-RC1
  Ioannidis 'Why Most Published Research Findings Are False' (PLOS Medicine, 2005)

  Landmark paper using Bayesian reasoning to demonstrate that for most study designs and settings, published research findings are more likely false than true. Became foundational text for understanding systemic bias in scientific publication. One of most-cited papers in medical literature.

• documentDOC-RC2
  Reproducibility Project: Psychology Report (Science, 2015)

  Coordinated effort by 270 researchers to replicate 100 psychology studies from three top journals found only 36-39% successfully reproduced original results. Effect sizes in replications averaged half those originally reported. Provided first systematic quantification of replication failure rates.

• documentDOC-RC3
  Nature Survey: 1,500 Scientists on Reproducibility (Nature, 2016)

  International survey revealed 70% of researchers failed to reproduce another scientist's experiments and 50% failed to reproduce their own. Over half of respondents believed significant crisis exists. Documented widespread awareness of problems across disciplines.

• documentDOC-RC4
  Simmons, Nelson & Simonsohn 'False-Positive Psychology' (Psychological Science, 2011)

  Demonstrated how standard research practices (flexible stopping rules, selective outcome reporting, covariates selection) allow researchers to find statistically significant results for literally any hypothesis including impossible claims. Introduced term 'researcher degrees of freedom' to describe systemic problem.

• testimonyDOC-RC5
  Stapel Investigation Committee Report (Tilburg University, 2012)

  Official investigation documented 58 retracted publications by prominent social psychologist Diederik Stapel who fabricated data over 15+ years. Report revealed systemic failures in supervision, data verification, and co-author due diligence that allowed fraud to persist despite warning signs.

• documentDOC-RC6
  Bem 'Feeling the Future' Precognition Study (Journal of Personality and Social Psychology, 2011)

  Peer-reviewed publication in top-tier journal claimed experimental evidence for precognition (participants predicting random future events). Immediate replication failures sparked debate about how statistically impossible findings could pass rigorous peer review using standard methodological practices.

• dataDOC-RC7
  Many Labs 2 Multi-Site Replication Results (Advances in Methods and Practices in Psychological Science, 2018)

  Coordinated replication across 36 laboratories in different countries found 14 of 28 classic psychological findings replicated. Study revealed substantial heterogeneity across sites even for successful replications, raising questions about context-dependency and generalizability of psychological effects.