skip to main content
DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Reproducibility and Transparency by Design

Abstract

Public trust of scientific research is often affected by the clarity of published conclusions and also the perceived transparency of the method. Even among scientists, there is often a skeptical reception to new research because of difficulty and sometimes inability to recreate or reproduce the result. The silent crisis of irreproducibility has many potential contributing factors, including: pressure to publish groundbreaking results, the difficulty of a single peer expert to fully review multi-disciplinary team science endeavors, and perceived lack of scientific credit for replicating or disproving a previous result. Although irreproducibility is not exclusive to biology, strong public interest in environmental and biomedical discoveries seems to have focused the spotlight here following a number of high profile studies that failed to be reproduced.

Authors:
ORCiD logo [1]; ORCiD logo [2]; ORCiD logo [3]
  1. Pacific Northwest National Lab. (PNNL), Richland, WA (United States)
  2. Univ. Catholique de Louvain, Brussels (Belgium)
  3. Brigham Young Univ., Provo, UT (United States)
Publication Date:
Research Org.:
Pacific Northwest National Lab. (PNNL), Richland, WA (United States)
Sponsoring Org.:
USDOE Office of Science (SC), Biological and Environmental Research (BER) (SC-23)
OSTI Identifier:
1572490
Report Number(s):
PNNL-SA-111442
Journal ID: ISSN 1535-9476
Grant/Contract Number:  
AC05-76RL01830
Resource Type:
Accepted Manuscript
Journal Name:
Molecular and Cellular Proteomics
Additional Journal Information:
Journal Volume: 18; Journal Issue: 8 suppl 1; Journal ID: ISSN 1535-9476
Publisher:
American Society for Biochemistry and Molecular Biology
Country of Publication:
United States
Language:
English
Subject:
59 BASIC BIOLOGICAL SCIENCES

Citation Formats

Petyuk, Vladislav A., Gatto, Laurent, and Payne, Samuel H. Reproducibility and Transparency by Design. United States: N. p., 2019. Web. doi:10.1074/mcp.IP119.001567.
Petyuk, Vladislav A., Gatto, Laurent, & Payne, Samuel H. Reproducibility and Transparency by Design. United States. doi:10.1074/mcp.IP119.001567.
Petyuk, Vladislav A., Gatto, Laurent, and Payne, Samuel H. Thu . "Reproducibility and Transparency by Design". United States. doi:10.1074/mcp.IP119.001567. https://www.osti.gov/servlets/purl/1572490.
@article{osti_1572490,
title = {Reproducibility and Transparency by Design},
author = {Petyuk, Vladislav A. and Gatto, Laurent and Payne, Samuel H.},
abstractNote = {Public trust of scientific research is often affected by the clarity of published conclusions and also the perceived transparency of the method. Even among scientists, there is often a skeptical reception to new research because of difficulty and sometimes inability to recreate or reproduce the result. The silent crisis of irreproducibility has many potential contributing factors, including: pressure to publish groundbreaking results, the difficulty of a single peer expert to fully review multi-disciplinary team science endeavors, and perceived lack of scientific credit for replicating or disproving a previous result. Although irreproducibility is not exclusive to biology, strong public interest in environmental and biomedical discoveries seems to have focused the spotlight here following a number of high profile studies that failed to be reproduced.},
doi = {10.1074/mcp.IP119.001567},
journal = {Molecular and Cellular Proteomics},
number = 8 suppl 1,
volume = 18,
place = {United States},
year = {2019},
month = {7}
}

Journal Article:
Free Publicly Available Full Text
Publisher's Version of Record

Citation Metrics:
Cited by: 1 work
Citation information provided by
Web of Science

Save / Share:

Works referenced in this record:

How open science helps researchers succeed
journal, July 2016

  • McKiernan, Erin C.; Bourne, Philip E.; Brown, C. Titus
  • eLife, Vol. 5
  • DOI: 10.7554/eLife.16800

Five selfish reasons to work reproducibly
journal, December 2015


Cell-to-cell expression variability followed by signal reinforcement progressively segregates early mouse lineages
journal, December 2013

  • Ohnishi, Yusuke; Huber, Wolfgang; Tsumura, Akiko
  • Nature Cell Biology, Vol. 16, Issue 1
  • DOI: 10.1038/ncb2881

Use of proteomic patterns in serum to identify ovarian cancer
journal, February 2002


Orchestrating high-throughput genomic analysis with Bioconductor
journal, January 2015

  • Huber, Wolfgang; Carey, Vincent J.; Gentleman, Robert
  • Nature Methods, Vol. 12, Issue 2
  • DOI: 10.1038/nmeth.3252

Sharing and community curation of mass spectrometry data with Global Natural Products Social Molecular Networking
journal, August 2016

  • Wang, Mingxun; Carver, Jeremy J.; Phelan, Vanessa V.
  • Nature Biotechnology, Vol. 34, Issue 8
  • DOI: 10.1038/nbt.3597

Initial Guidelines for Manuscripts Employing Data-independent Acquisition Mass Spectrometry for Proteomic Analysis
journal, January 2019

  • Chalkley, Robert J.; MacCoss, Michael J.; Jaffe, Jacob D.
  • Molecular & Cellular Proteomics, Vol. 18, Issue 1
  • DOI: 10.1074/mcp.E118.001286

Absence of Detectable Arsenate in DNA from Arsenate-Grown GFAJ-1 Cells
journal, July 2012


New Guidelines for Publication of Manuscripts Describing Development and Application of Targeted Mass Spectrometry Measurements of Peptides and Proteins
journal, February 2017

  • Abbatiello, Susan; Ackermann, Bradley L.; Borchers, Christoph
  • Molecular & Cellular Proteomics, Vol. 16, Issue 3
  • DOI: 10.1074/mcp.E117.067801

Toward a Shared Vision for Cancer Genomic Data
journal, September 2016

  • Grossman, Robert L.; Heath, Allison P.; Ferretti, Vincent
  • New England Journal of Medicine, Vol. 375, Issue 12
  • DOI: 10.1056/NEJMp1607591

The ProteomeXchange consortium in 2017: supporting the cultural change in proteomics public data deposition
journal, October 2016

  • Deutsch, Eric W.; Csordas, Attila; Sun, Zhi
  • Nucleic Acids Research, Vol. 45, Issue D1
  • DOI: 10.1093/nar/gkw936

Widespread RNA and DNA Sequence Differences in the Human Transcriptome
journal, May 2011


Cancer Biomarkers: Can We Turn Recent Failures into Success?
journal, August 2010

  • Diamandis, E. P.
  • JNCI Journal of the National Cancer Institute, Vol. 102, Issue 19
  • DOI: 10.1093/jnci/djq306

BioContainers: an open-source and community-driven framework for software standardization
journal, March 2017


Ten Simple Rules for Taking Advantage of Git and GitHub
journal, July 2016


A data repository and analysis framework for spontaneous neural activity recordings in developing retina
journal, March 2014

  • Eglen, Stephen John; Weeks, Michael; Jessop, Mark
  • GigaScience, Vol. 3, Issue 1
  • DOI: 10.1186/2047-217X-3-3

Blazing Signature Filter: a library for fast pairwise similarity comparisons
journal, June 2018


Protein Sequences from Mastodon and Tyrannosaurus Rex Revealed by Mass Spectrometry
journal, April 2007


Mapping genetic interactions in human cancer cells with RNAi and multiparametric phenotyping
journal, April 2013

  • Laufer, Christina; Fischer, Bernd; Billmann, Maximilian
  • Nature Methods, Vol. 10, Issue 5
  • DOI: 10.1038/nmeth.2436