The pipeline project: Pre-publication independent replications of a single laboratory's research pipeline

This crowdsourced project introduces a collaborative approach to improving the reproducibility of scientific research, in which findings are replicated in qualified independent laboratories before (rather than after) they are published. Our goal is to establish a non-adversarial replication process...

Full description

Saved in:
Bibliographic Details
Main Authors: SCHWEINSBERG, Martin, MADAN, Nikhil, VIANELLO, Michelangelo, SOMMER, S.Amy, JORDAN, Jennifer, al, et, SCHAERER, Michael
Format: text
Language:English
Published: Institutional Knowledge at Singapore Management University 2016
Subjects:
Online Access:https://ink.library.smu.edu.sg/lkcsb_research/5159
https://ink.library.smu.edu.sg/context/lkcsb_research/article/6158/viewcontent/Schweinsberg_et_al_JESP2016_the_pipeline_project__1_.pdf
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Singapore Management University
Language: English
id sg-smu-ink.lkcsb_research-6158
record_format dspace
spelling sg-smu-ink.lkcsb_research-61582019-07-08T09:31:29Z The pipeline project: Pre-publication independent replications of a single laboratory's research pipeline SCHWEINSBERG, Martin MADAN, Nikhil VIANELLO, Michelangelo SOMMER, S.Amy JORDAN, Jennifer al, et SCHAERER, Michael This crowdsourced project introduces a collaborative approach to improving the reproducibility of scientific research, in which findings are replicated in qualified independent laboratories before (rather than after) they are published. Our goal is to establish a non-adversarial replication process with highly informative final results. To illustrate the Pre-Publication Independent Replication (PPIR) approach, 25 research groups conducted replications of all ten moral judgment effects which the last author and his collaborators had “in the pipeline” as of August 2014. Six findings replicated according to all replication criteria, one finding replicated but with a significantly smaller effect size than the original, one finding replicated consistently in the original culture but not outside of it, and two findings failed to find support. In total, 40% of the original findings failed at least one major replication criterion. Potential ways to implement and incentivize pre-publication independent replication on a large scale are discussed. 2016-09-01T07:00:00Z text application/pdf https://ink.library.smu.edu.sg/lkcsb_research/5159 info:doi/10.1016/j.jesp.2015.10.001 https://ink.library.smu.edu.sg/context/lkcsb_research/article/6158/viewcontent/Schweinsberg_et_al_JESP2016_the_pipeline_project__1_.pdf http://creativecommons.org/licenses/by-nc-nd/4.0/ Research Collection Lee Kong Chian School Of Business eng Institutional Knowledge at Singapore Management University Crowdsourcing science Replication Reproducibility Research transparency Methodology Meta-science Management Sciences and Quantitative Methods
institution Singapore Management University
building SMU Libraries
continent Asia
country Singapore
Singapore
content_provider SMU Libraries
collection InK@SMU
language English
topic Crowdsourcing science
Replication
Reproducibility
Research transparency
Methodology
Meta-science
Management Sciences and Quantitative Methods
spellingShingle Crowdsourcing science
Replication
Reproducibility
Research transparency
Methodology
Meta-science
Management Sciences and Quantitative Methods
SCHWEINSBERG, Martin
MADAN, Nikhil
VIANELLO, Michelangelo
SOMMER, S.Amy
JORDAN, Jennifer
al, et
SCHAERER, Michael
The pipeline project: Pre-publication independent replications of a single laboratory's research pipeline
description This crowdsourced project introduces a collaborative approach to improving the reproducibility of scientific research, in which findings are replicated in qualified independent laboratories before (rather than after) they are published. Our goal is to establish a non-adversarial replication process with highly informative final results. To illustrate the Pre-Publication Independent Replication (PPIR) approach, 25 research groups conducted replications of all ten moral judgment effects which the last author and his collaborators had “in the pipeline” as of August 2014. Six findings replicated according to all replication criteria, one finding replicated but with a significantly smaller effect size than the original, one finding replicated consistently in the original culture but not outside of it, and two findings failed to find support. In total, 40% of the original findings failed at least one major replication criterion. Potential ways to implement and incentivize pre-publication independent replication on a large scale are discussed.
format text
author SCHWEINSBERG, Martin
MADAN, Nikhil
VIANELLO, Michelangelo
SOMMER, S.Amy
JORDAN, Jennifer
al, et
SCHAERER, Michael
author_facet SCHWEINSBERG, Martin
MADAN, Nikhil
VIANELLO, Michelangelo
SOMMER, S.Amy
JORDAN, Jennifer
al, et
SCHAERER, Michael
author_sort SCHWEINSBERG, Martin
title The pipeline project: Pre-publication independent replications of a single laboratory's research pipeline
title_short The pipeline project: Pre-publication independent replications of a single laboratory's research pipeline
title_full The pipeline project: Pre-publication independent replications of a single laboratory's research pipeline
title_fullStr The pipeline project: Pre-publication independent replications of a single laboratory's research pipeline
title_full_unstemmed The pipeline project: Pre-publication independent replications of a single laboratory's research pipeline
title_sort pipeline project: pre-publication independent replications of a single laboratory's research pipeline
publisher Institutional Knowledge at Singapore Management University
publishDate 2016
url https://ink.library.smu.edu.sg/lkcsb_research/5159
https://ink.library.smu.edu.sg/context/lkcsb_research/article/6158/viewcontent/Schweinsberg_et_al_JESP2016_the_pipeline_project__1_.pdf
_version_ 1770573594416381952