Open data · CC BY 4.0 what each one claims, and what replicated no ads · no tracking
Bias Atlascognitive biases

The projects that tested many at once

12 studies

12 studies in this index retested more than one of these effects, and between them they account for 63 of the 544 entries. The largest, Many Labs 2, settled 22 on its own.

12 projects63 entries covered22 in the largest

A verdict on an entry page looks like its own small story. Often it is one row of a table in a paper that tested forty effects at once — and these are those papers, with everything each of them settled.

Many Labs 2 22 entries

Klein, R. A., Vianello, M., Hasselman, F., et al. (2018). Many Labs 2: Investigating variation in replicability across samples and settings. Advances in Methods and Practices in Psychological Science, 1(4), 443-490. Effect 28, Tversky and Gati (1978), Study 2.

7,205 participants · 64 sites

6 replicated · 10 mixed · 6 failed

Camerer (2018) 9 entries

Camerer, C. F., Dreber, A., Holzmeister, F., Ho, T.-H., Huber, J., Johannesson, M., et al. (2018). Evaluating the replicability of social science experiments in Nature and Science between 2010 and 2015. Nature Human Behaviour, 2(9), 637-644. Kovács et al. (2010) is one of its 21 studies; the figures here are from the project's replication report for that study.

234 participants · 1 sites

3 replicated · 3 mixed · 3 failed

Klein (2014) 8 entries

Klein, R. A., Ratliff, K. A., Vianello, M., Adams, R. B., Jr., Bahník, Š., Bernstein, M. J., et al. (2014). Investigating variation in replicability: A 'many labs' replication project. Social Psychology, 45(3), 142-152.

6,330 participants · 36 sites

7 replicated · 1 mixed · 0 failed

Many Labs 3 7 entries

Ebersole, C. R., Atherton, O. E., Belanger, A. L., Skulborstad, H. M., Allen, J. M., Banks, J. B., et al. (2016). Many Labs 3: Evaluating participant pool quality across the academic semester via replication. Journal of Experimental Social Psychology, 67, 68-82. The power and perspective taking section is 4.5.

2,285 participants · 20 sites

1 replicated · 4 mixed · 2 failed

Khemlani (2012) 3 entries

Khemlani, S., & Johnson-Laird, P. N. (2012). Theories of the syllogism: A meta-analysis. Psychological Bulletin, 138(3), 427-457.

3 replicated · 0 mixed · 0 failed

Ervas (2018) 2 entries

Ervas, F., Ledda, A., Ojha, A., Pierro, G. A., & Indurkhya, B. (2018). Creative Argumentation: When and Why People Commit the Metaphoric Fallacy. Frontiers in Psychology, 9, 1815.

147 participants

2 replicated · 0 mixed · 0 failed

Lo Iacono (2022) 2 entries

Lo Iacono, S., & Dores Cruz, T. D. (2022). Hostile media perception affects news bias, but not news sharing intentions. Royal Society Open Science, 9(4), 211504.

1,636 participants

2 replicated · 0 mixed · 0 failed

Mayiwar (2025) 2 entries

Mayiwar, L., Wan, K. H., Løhre, E., & Feldman, G. (2025). Revisiting representativeness heuristic classic paradigms: Replication and extensions of nine experiments in Kahneman and Tversky (1972). Quarterly Journal of Experimental Psychology, 78(4), 707-730.

623 participants

0 replicated · 2 mixed · 0 failed

Murphy (2023) 2 entries

Murphy, G., Dawson, C. A., Huston, C., Ballantyne, L., Barrett, E., Cowman, C. S., Fitzsimons, C., Maher, J., Ryan, K. M., & Greene, C. M. (2023). Lost in the mall again: a preregistered replication and extension of Loftus & Pickrell (1995). Memory, 31(6), 818-830.

123 participants

1 replicated · 1 mixed · 0 failed

Robbins (2005) 2 entries

Robbins, J. M., & Krueger, J. I. (2005). Social projection to ingroups and outgroups: A review and meta-analysis. Personality and Social Psychology Review, 9(1), 32-47.

5,053 participants

1 replicated · 1 mixed · 0 failed

Ruggeri (2020) 2 entries

Ruggeri, K., Alí, S., Berge, M. L., et al. (2020). Replicating patterns of prospect theory for decision under risk. Nature Human Behaviour, 4(6), 622-633.

4,098 participants

1 replicated · 1 mixed · 0 failed

Većkalov (2024) 2 entries

Većkalov, B., Geiger, S. J., Bartoš, F., et al. (2024). A 27-country test of communicating the scientific consensus on climate change. Nature Human Behaviour, 8(10), 1892-1905. Preregistered; n = 10,527 across 27 countries.

10,527 participants

0 replicated · 2 mixed · 0 failed

Questions about these projects

Why group entries by the study that retested them?

Because an entry page makes each verdict look like its own small story, and often it is not. A multi-laboratory project runs dozens of effects through one protocol in one year, so nineteen verdicts here can be nineteen rows of a single table in a single paper. That is worth knowing before you quote any of them.

How are entries grouped into a project?

By DOI, which is the identifier a publisher assigns to one paper — not by matching citation text. Five of these projects are cited two ways in the corpus, differing only in how far the author list runs before "et al.", and grouping on the text split Many Labs 2 into a block of 19 and a block of 3. Where a study carries no DOI its citation is still the key, because then there is nothing better.