Investigating Variation in Replicability A "Many Labs'' Replication Project Academic Article uri icon

abstract

  • Although replication is a central tenet of science, direct replications are rare in psychology. This research tested variation in the replicability of 13 classic and contemporary effects across 36 independent samples totaling 6,344 participants. In the aggregate, 10 effects replicated consistently. One effect imagined contact reducing prejudice showed weak support for replicability. And two effects flag priming influencing conservatism and currency priming influencing system justification did not replicate. We compared whether the conditions such as lab versus online or US versus international sample predicted effect magnitudes. By and large they did not. The results of this small sample of effects suggest that replicability is more dependent on the effect itself than on the sample and setting used to investigate the effect.

published proceedings

  • SOCIAL PSYCHOLOGY

altmetric score

  • 221.962

author list (cited authors)

  • Klein, R. A., Ratliff, K. A., Vianello, M., Adams, R., Bahnik, S., Bernstein, M. J., ... Nosek, B. A.

citation count

  • 761

complete list of authors

  • Klein, Richard A||Ratliff, Kate A||Vianello, Michelangelo||Adams, Reginald B Jr||Bahnik, Stepan||Bernstein, Michael J||Bocian, Konrad||Brandt, Mark J||Brooks, Beach||Brumbaugh, Claudia Chloe||Cemalcilar, Zeynep||Chandler, Jesse||Cheong, Winnee||Davis, William E||Devos, Thierry||Eisner, Matthew||Frankowska, Natalia||Furrow, David||Galliani, Elisa Maria||Hasselman, Fred||Hicks, Joshua A||Hovermale, James F||Hunt, S Jane||Huntsinger, Jeffrey R||IJzerman, Hans||John, Melissa-Sue||Joy-Gaba, Jennifer A||Kappes, Heather Barry||Krueger, Lacy E||Kurtz, Jaime||Levitan, Carmel A||Mallett, Robyn K||Morris, Wendy L||Nelson, Anthony J||Nier, Jason A||Packard, Grant||Pilati, Ronaldo||Rutchick, Abraham M||Schmidt, Kathleen||Skorinko, Jeanine L||Smith, Robert||Steiner, Troy G||Storbeck, Justin||Van Swol, Lyn M||Thompson, Donna||van 't Veer, AE||Vaughn, Leigh Ann||Vranka, Marek||Wichman, Aaron L||Woodzicka, Julie A||Nosek, Brian A

publication date

  • May 2014