|
2
|
Tierney W, Schweinsberg M, Jordan J, Kennedy DM, Qureshi I, Sommer SA, Thornley N, Madan N, Vianello M, Awtrey E, Zhu LL, Diermeier D, Heinze JE, Srinivasan M, Tannenbaum D, Bivolaru E, Dana J, Davis-Stober CP, du Plessis C, Gronau QF, Hafenbrack AC, Liao EY, Ly A, Marsman M, Murase T, Schaerer M, Tworek CM, Wagenmakers EJ, Wong L, Anderson T, Bauman CW, Bedwell WL, Brescoll V, Canavan A, Chandler JJ, Cheries E, Cheryan S, Cheung F, Cimpian A, Clark MA, Cordon D, Cushman F, Ditto PH, Amell A, Frick SE, Gamez-Djokic M, Grady RH, Graham J, Gu J, Hahn A, Hanson BE, Hartwich NJ, Hein K, Inbar Y, Jiang L, Kellogg T, Legate N, Luoma TP, Maibeucher H, Meindl P, Miles J, Mislin A, Molden DC, Motyl M, Newman G, Ngo HH, Packham H, Ramsay PS, Ray JL, Sackett AM, Sellier AL, Sokolova T, Sowden W, Storage D, Sun X, Van Bavel JJ, Washburn AN, Wei C, Wetter E, Wilson CT, Darroux SC, Uhlmann EL. Data from a pre-publication independent replication initiative examining ten moral judgement effects. Sci Data 2016; 3:160082. [PMID: 27727246 PMCID: PMC5058337 DOI: 10.1038/sdata.2016.82] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/04/2016] [Accepted: 08/12/2016] [Indexed: 11/09/2022] Open
Abstract
We present the data from a crowdsourced project seeking to replicate findings in independent laboratories before (rather than after) they are published. In this Pre-Publication Independent Replication (PPIR) initiative, 25 research groups attempted to replicate 10 moral judgment effects from a single laboratory's research pipeline of unpublished findings. The 10 effects were investigated using online/lab surveys containing psychological manipulations (vignettes) followed by questionnaires. Results revealed a mix of reliable, unreliable, and culturally moderated findings. Unlike any previous replication project, this dataset includes the data from not only the replications but also from the original studies, creating a unique corpus that researchers can use to better understand reproducibility and irreproducibility in science.
Collapse
Affiliation(s)
- Warren Tierney
- INSEAD, Fontainebleau 77305, France and Singapore 138676, Singapore
| | | | | | | | - Israr Qureshi
- IE Business School, IE University, Madrid 28006, Spain
| | | | - Nico Thornley
- INSEAD, Fontainebleau 77305, France and Singapore 138676, Singapore
| | - Nikhil Madan
- INSEAD, Fontainebleau 77305, France and Singapore 138676, Singapore
| | | | - Eli Awtrey
- University of Washington, Seattle 98195, USA
| | - Luke Lei Zhu
- University of Manitoba, Winnipeg R3T 5V4, Canada
| | | | | | | | | | - Eliza Bivolaru
- INSEAD, Fontainebleau 77305, France and Singapore 138676, Singapore
| | | | | | | | | | - Andrew C Hafenbrack
- UCP-Católica Lisbon School of Business &Economics, Lisbon 1649-023, Portugal
| | - Eko Yi Liao
- Hang Seng Management College, Hong Kong, Hong Kong
| | - Alexander Ly
- University of Amsterdam, Amsterdam 1001 NK, The Netherlands
| | | | | | - Michael Schaerer
- INSEAD, Fontainebleau 77305, France and Singapore 138676, Singapore
| | | | | | - Lynn Wong
- INSEAD, Fontainebleau 77305, France and Singapore 138676, Singapore
| | | | | | | | | | | | - Jesse J Chandler
- Institute for Social Research, University of Michigan, Ann Arbor 48104, USA
| | - Erik Cheries
- University of Massachusetts Amherst, Amherst 1003, USA
| | | | - Felix Cheung
- Washington University in St Louis, St Louis 63130, USA.,University of Hong Kong, Hong Kong, Hong Kong
| | - Andrei Cimpian
- Department of Psychology, New York University, New York 10003, USA
| | | | - Diana Cordon
- Illinois Institute of Technology, Chicago 60616, USA
| | | | | | - Alice Amell
- Illinois Institute of Technology, Chicago 60616, USA
| | | | | | | | - Jesse Graham
- University of Southern California, Los Angeles 90089, USA
| | - Jun Gu
- Monash University, Melbourne 3145, Australia
| | - Adam Hahn
- Social Cognition Center Cologne, University of Cologne, Koeln 50931, Germany
| | | | - Nicole J Hartwich
- Social Cognition Center Cologne, University of Cologne, Koeln 50931, Germany
| | - Kristie Hein
- Illinois Institute of Technology, Chicago 60616, USA
| | - Yoel Inbar
- University of Toronto, Toronto ON M5S, Canada
| | - Lily Jiang
- University of Washington, Seattle 98195, USA
| | | | - Nicole Legate
- Illinois Institute of Technology, Chicago 60616, USA
| | - Timo P Luoma
- Social Cognition Center Cologne, University of Cologne, Koeln 50931, Germany
| | | | - Peter Meindl
- University of Pennsylvania, Philadelphia 19104, USA
| | | | | | | | - Matt Motyl
- University of Illinois at Chicago, Chicago 60607, USA
| | | | - Hoai Huong Ngo
- Université Paris Ouest Nanterre La Défense, Nanterre 92000, France
| | | | | | - Jennifer L Ray
- Department of Psychology, New York University, New York 10003, USA
| | | | | | | | - Walter Sowden
- Centre for Psychiatry and Neuroscience, Walter Reed Army Institute of Research (WRAIR), Silver Spring 20910, USA
| | - Daniel Storage
- University of Illinois at Urbana-Champaign, Champaign 61820, USA
| | - Xiaomin Sun
- Beijing Normal University, Beijing 100875, China
| | - Jay J Van Bavel
- Department of Psychology, New York University, New York 10003, USA
| | | | - Cong Wei
- Beijing Normal University, Beijing 100875, China
| | - Erik Wetter
- Stockholm School of Economics, Stockholm 11383, Sweden
| | | | | | | |
Collapse
|
|
3
|
Schweinsberg M, Madan N, Vianello M, Sommer SA, Jordan J, Tierney W, Awtrey E, Zhu LL, Diermeier D, Heinze JE, Srinivasan M, Tannenbaum D, Bivolaru E, Dana J, Davis-Stober CP, du Plessis C, Gronau QF, Hafenbrack AC, Liao EY, Ly A, Marsman M, Murase T, Qureshi I, Schaerer M, Thornley N, Tworek CM, Wagenmakers EJ, Wong L, Anderson T, Bauman CW, Bedwell WL, Brescoll V, Canavan A, Chandler JJ, Cheries E, Cheryan S, Cheung F, Cimpian A, Clark MA, Cordon D, Cushman F, Ditto PH, Donahue T, Frick SE, Gamez-Djokic M, Grady RH, Graham J, Gu J, Hahn A, Hanson BE, Hartwich NJ, Hein K, Inbar Y, Jiang L, Kellogg T, Kennedy DM, Legate N, Luoma TP, Maibuecher H, Meindl P, Miles J, Mislin A, Molden DC, Motyl M, Newman G, Ngo HH, Packham H, Ramsay PS, Ray JL, Sackett AM, Sellier AL, Sokolova T, Sowden W, Storage D, Sun X, Van Bavel JJ, Washburn AN, Wei C, Wetter E, Wilson CT, Darroux SC, Uhlmann EL. The pipeline project: Pre-publication independent replications of a single laboratory's research pipeline. Journal of Experimental Social Psychology 2016. [DOI: 10.1016/j.jesp.2015.10.001] [Citation(s) in RCA: 57] [Impact Index Per Article: 7.1] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/11/2022]
|