Summary of the 2014 Sandia V&V Challenge Workshop
Abstract
A discussion of the five responses to the 2014 Sandia Verification and Validation (V&V) Challenge Problem, presented within this special issue, is provided hereafter. Overviews of the challenge problem workshop, workshop participants, and the problem statement are also included. Brief summations of teams' responses to the challenge problem are provided. Issues that arose throughout the responses that are deemed applicable to the general verification, validation, and uncertainty quantification (VVUQ) community are the main focal point of this paper. The discussion is oriented and organized into big picture comparison of data and model usage, VVUQ activities, and differentiating conceptual themes behind the teams' VVUQ strategies. Significant differences are noted in the teams' approaches toward all VVUQ activities, and those deemed most relevant are discussed. Beyond the specific details of VVUQ implementations, thematic concepts are found to create differences among the approaches; some of the major themes are discussed. Lastly, an encapsulation of the key contributions, the lessons learned, and advice for the future are presented.
- Authors:
-
- Sandia National Lab. (SNL-NM), Albuquerque, NM (United States)
- Publication Date:
- Research Org.:
- Sandia National Lab. (SNL-NM), Albuquerque, NM (United States)
- Sponsoring Org.:
- USDOE National Nuclear Security Administration (NNSA)
- OSTI Identifier:
- 1238674
- Report Number(s):
- SAND-2015-10602J
Journal ID: ISSN 2377-2158; 614814
- Grant/Contract Number:
- AC04-94AL85000
- Resource Type:
- Accepted Manuscript
- Journal Name:
- Journal of Verification, Validation and Uncertainty Quantification
- Additional Journal Information:
- Journal Volume: 1; Journal Issue: 1; Journal ID: ISSN 2377-2158
- Publisher:
- ASME
- Country of Publication:
- United States
- Language:
- English
- Subject:
- 42 ENGINEERING; 97 MATHEMATICS AND COMPUTING; workshops; work spaces; teams; uncertainty
Citation Formats
Schroeder, Benjamin B., Hu, Kenneth T., Mullins, Joshua Grady, and Winokur, Justin G. Summary of the 2014 Sandia V&V Challenge Workshop. United States: N. p., 2016.
Web. doi:10.1115/1.4032563.
Schroeder, Benjamin B., Hu, Kenneth T., Mullins, Joshua Grady, & Winokur, Justin G. Summary of the 2014 Sandia V&V Challenge Workshop. United States. https://doi.org/10.1115/1.4032563
Schroeder, Benjamin B., Hu, Kenneth T., Mullins, Joshua Grady, and Winokur, Justin G. Fri .
"Summary of the 2014 Sandia V&V Challenge Workshop". United States. https://doi.org/10.1115/1.4032563. https://www.osti.gov/servlets/purl/1238674.
@article{osti_1238674,
title = {Summary of the 2014 Sandia V&V Challenge Workshop},
author = {Schroeder, Benjamin B. and Hu, Kenneth T. and Mullins, Joshua Grady and Winokur, Justin G.},
abstractNote = {A discussion of the five responses to the 2014 Sandia Verification and Validation (V&V) Challenge Problem, presented within this special issue, is provided hereafter. Overviews of the challenge problem workshop, workshop participants, and the problem statement are also included. Brief summations of teams' responses to the challenge problem are provided. Issues that arose throughout the responses that are deemed applicable to the general verification, validation, and uncertainty quantification (VVUQ) community are the main focal point of this paper. The discussion is oriented and organized into big picture comparison of data and model usage, VVUQ activities, and differentiating conceptual themes behind the teams' VVUQ strategies. Significant differences are noted in the teams' approaches toward all VVUQ activities, and those deemed most relevant are discussed. Beyond the specific details of VVUQ implementations, thematic concepts are found to create differences among the approaches; some of the major themes are discussed. Lastly, an encapsulation of the key contributions, the lessons learned, and advice for the future are presented.},
doi = {10.1115/1.4032563},
journal = {Journal of Verification, Validation and Uncertainty Quantification},
number = 1,
volume = 1,
place = {United States},
year = {Fri Feb 19 00:00:00 EST 2016},
month = {Fri Feb 19 00:00:00 EST 2016}
}
Free Publicly Available Full Text
Publisher's Version of Record
Other availability
Search WorldCat to find libraries that may hold this journal
Save to My Library
You must Sign In or Create an Account in order to save documents to your library.
Works referenced in this record:
Introduction: The 2014 Sandia Verification and Validation Challenge Workshop
journal, February 2016
- Hu, Kenneth T.; Carnes, Brian; Romero, Vicente
- Journal of Verification, Validation and Uncertainty Quantification, Vol. 1, Issue 1
Alternative representations of epistemic uncertainty
journal, July 2004
- Helton, J. C.; Oberkampf, W. L.
- Reliability Engineering & System Safety, Vol. 85, Issue 1-3
Validation Challenge Workshop
journal, May 2008
- Hills, Richard G.; Pilch, Martin; Dowding, Kevin J.
- Computer Methods in Applied Mechanics and Engineering, Vol. 197, Issue 29-32
Sandia Verification and Validation Challenge Problem: A PCMM-Based Approach to Assessing Prediction Credibility
journal, February 2016
- Beghini, Lauren L.; Hough, Patricia D.
- Journal of Verification, Validation and Uncertainty Quantification, Vol. 1, Issue 1
Probability Bounds Analysis Applied to the Sandia Verification and Validation Challenge Problem
journal, February 2016
- Choudhary, Aniruddha; Voyles, Ian T.; Roy, Christopher J.
- Journal of Verification, Validation and Uncertainty Quantification, Vol. 1, Issue 1
Integrating Bayesian Calibration, Bias Correction, and Machine Learning for the 2014 Sandia Verification and Validation Challenge Problem
journal, February 2016
- Li, Wei; Chen, Shishi; Jiang, Zhen
- Journal of Verification, Validation and Uncertainty Quantification, Vol. 1, Issue 1
Reliability Analysis With Model Uncertainty Coupling With Parameter and Experiment Uncertainties: A Case Studyof 2014 Verification and Validation Challenge Problem
journal, December 2015
- Xi, Zhimin; Yang, Ren-Jye
- Journal of Verification, Validation and Uncertainty Quantification, Vol. 1, Issue 1
Bayesian Uncertainty Integration for Model Calibration, Validation, and Prediction
journal, February 2016
- Mullins, Joshua; Mahadevan, Sankaran
- Journal of Verification, Validation and Uncertainty Quantification, Vol. 1, Issue 1
Economic Analysis of Model Validation for a Challenge Problem
journal, February 2016
- Paez, Paul J.; Paez, Thomas L.; Hasselman, Timothy K.
- Journal of Verification, Validation and Uncertainty Quantification, Vol. 1, Issue 1
Efficient Global Reliability Analysis for Nonlinear Implicit Performance Functions
journal, October 2008
- Bichon, B. J.; Eldred, M. S.; Swiler, L. P.
- AIAA Journal, Vol. 46, Issue 10
Model validation and predictive capability for the thermal challenge problem
journal, May 2008
- Ferson, Scott; Oberkampf, William L.; Ginzburg, Lev
- Computer Methods in Applied Mechanics and Engineering, Vol. 197, Issue 29-32
Bayesian calibration of computer models
journal, August 2001
- Kennedy, Marc C.; O'Hagan, Anthony
- Journal of the Royal Statistical Society: Series B (Statistical Methodology), Vol. 63, Issue 3
Verification and validation in computational fluid dynamics
journal, April 2002
- Oberkampf, William L.; Trucano, Timothy G.
- Progress in Aerospace Sciences, Vol. 38, Issue 3
Summary from the epistemic uncertainty workshop: consensus amid diversity
journal, July 2004
- Ferson, Scott; Joslyn, Cliff A.; Helton, Jon C.
- Reliability Engineering & System Safety, Vol. 85, Issue 1-3
Review of code and solution verification procedures for computational simulation
journal, May 2005
- Roy, Christopher J.
- Journal of Computational Physics, Vol. 205, Issue 1
Calibration, validation, and sensitivity analysis: What's what
journal, October 2006
- Trucano, T. G.; Swiler, L. P.; Igusa, T.
- Reliability Engineering & System Safety, Vol. 91, Issue 10-11
Selection of model discrepancy priors in Bayesian calibration
journal, November 2014
- Ling, You; Mullins, Joshua; Mahadevan, Sankaran
- Journal of Computational Physics, Vol. 276
Works referencing / citing this record:
Model-Based Reliability Analysis With Both Model Uncertainty and Parameter Uncertainty
journal, January 2019
- Xi, Zhimin
- Journal of Mechanical Design, Vol. 141, Issue 5