The Replication Crisis: Why Researchers Should Care and What We Can Do About It
summary
Psychology replication projects find weak reproducibility: 15 of 28 studies replicated and large projects often reproduce only about 36–39% of effects. High‑profile findings crumble — the marshmallow effect disappears after controlling for maternal education and child IQ, priming effects fail to reappear, and power posing’s hormonal claim does not replicate. Recommended practice includes predeclared hypotheses, explicit signal thresholds, geographic and demographic diversity, small staged experiments to test interventions, and sharing counterexamples so decisions rest on tested, iterative evidence.
AI-written summary · about
chapters (6)
- 0:00Introduction to research challenges
- 3:07What is the replication crisis
- 8:09Examples of failed replications
- 11:41Confirmation bias in research
- 14:52Mitigating risks in UX research
- 18:47Conclusion and confidence in research
related talks
45mHow to do effective research in an irrational world
40mDesigning an Intentional Future With UXR
41mUnderstanding and Reducing Online Misinformation Across 16 Countries...
39mHow to DESTROY any idea with a little (really, too little) Psychology.
35mCognitive Biases and the User Experience
57mWorkshop: Cognitive Biases When Testing Product Hypotheses — How to Detect and Fix Them
19mTerms of Engagement: Research as a Team Sport.
20mTowards Personality-driven Persuasive Health Games and Gamified Systems