skip to main content
DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: ACM TOMS replicated computational results initiative

Abstract

In this study, the scientific community relies on the peer review process for assuring the quality of published material, the goal of which is to build a body of work we can trust. Computational journals such as The ACM Transactions on Mathematical Software (TOMS) use this process for rigorously promoting the clarity and completeness of content, and citation of prior work. At the same time, it is unusual to independently confirm computational results.

Authors:
 [1]
  1. Sandia National Lab. (SNL-NM), Albuquerque, NM (United States)
Publication Date:
Research Org.:
Sandia National Lab. (SNL-NM), Albuquerque, NM (United States)
Sponsoring Org.:
USDOE National Nuclear Security Administration (NNSA)
OSTI Identifier:
1235340
Report Number(s):
SAND-2015-20790J
Journal ID: ISSN 0098-3500; 558227
Grant/Contract Number:  
AC04-94AL85000
Resource Type:
Accepted Manuscript
Journal Name:
ACM Transactions on Mathematical Software
Additional Journal Information:
Journal Volume: 41; Journal Issue: 3; Journal ID: ISSN 0098-3500
Publisher:
ACM
Country of Publication:
United States
Language:
English
Subject:
97 MATHEMATICS AND COMPUTING; replicated computational results; reproducibility; publication

Citation Formats

Heroux, Michael Allen. ACM TOMS replicated computational results initiative. United States: N. p., 2015. Web. doi:10.1145/2743015.
Heroux, Michael Allen. ACM TOMS replicated computational results initiative. United States. doi:10.1145/2743015.
Heroux, Michael Allen. Wed . "ACM TOMS replicated computational results initiative". United States. doi:10.1145/2743015. https://www.osti.gov/servlets/purl/1235340.
@article{osti_1235340,
title = {ACM TOMS replicated computational results initiative},
author = {Heroux, Michael Allen},
abstractNote = {In this study, the scientific community relies on the peer review process for assuring the quality of published material, the goal of which is to build a body of work we can trust. Computational journals such as The ACM Transactions on Mathematical Software (TOMS) use this process for rigorously promoting the clarity and completeness of content, and citation of prior work. At the same time, it is unusual to independently confirm computational results.},
doi = {10.1145/2743015},
journal = {ACM Transactions on Mathematical Software},
number = 3,
volume = 41,
place = {United States},
year = {2015},
month = {6}
}

Journal Article:
Free Publicly Available Full Text
Publisher's Version of Record

Citation Metrics:
Cited by: 2 works
Citation information provided by
Web of Science

Save / Share:

Works referenced in this record:

Phase II failures: 2008–2010
journal, April 2011

  • Arrowsmith, John
  • Nature Reviews Drug Discovery, Vol. 10, Issue 5
  • DOI: 10.1038/nrd3439

Automated Capture of Experiment Context for Easier Reproducibility in Computational Research
journal, July 2012


Testing Scientific Programs
journal, July 2012


Making Computations and Publications Reproducible with VisTrails
journal, July 2012

  • Freire, Juliana; Silva, Claudio T.
  • Computing in Science & Engineering, Vol. 14, Issue 4
  • DOI: 10.1109/MCSE.2012.76

Three Dream Applications of Verifiable Computational Results
journal, July 2012

  • Gavish, Matan; Donoho, David
  • Computing in Science & Engineering, Vol. 14, Issue 4
  • DOI: 10.1109/MCSE.2012.65

Virtual Appliances, Cloud Computing, and Reproducible Research
journal, July 2012


Code Sharing Is Associated with Research Impact in Image Processing
journal, July 2012

  • Vandewalle, Patrick
  • Computing in Science & Engineering, Vol. 14, Issue 4
  • DOI: 10.1109/MCSE.2012.63

Replicated Computational Results (RCR) Report for “BLIS: A Framework for Rapidly Instantiating BLAS Functionality”
journal, June 2015

  • Willenbring, James M.
  • ACM Transactions on Mathematical Software, Vol. 41, Issue 3
  • DOI: 10.1145/2738033

    Works referencing / citing this record:

    Successes and Struggles with Computational Reproducibility: Lessons from the Fragile Families Challenge
    journal, January 2019

    • Liu, David M.; Salganik, Matthew J.
    • Socius: Sociological Research for a Dynamic World, Vol. 5
    • DOI: 10.1177/2378023119849803