Summary of the 2014 Sandia V&V Challenge Workshop

Schroeder, Benjamin B.; Hu, Kenneth T.; Mullins, Joshua Grady; Winokur, Justin G.

doi:10.1115/1.4032563

Title: Summary of the 2014 Sandia V&V Challenge Workshop

Journal Article · Fri Feb 19 00:00:00 EST 2016 · Journal of Verification, Validation and Uncertainty Quantification

DOI:https://doi.org/10.1115/1.4032563· OSTI ID:1238674

Schroeder, Benjamin B. ^[1]; Hu, Kenneth T. ^[1]; Mullins, Joshua Grady ^[1]; Winokur, Justin G. ^[1]

Sandia National Lab. (SNL-NM), Albuquerque, NM (United States)

A discussion of the five responses to the 2014 Sandia Verification and Validation (V&V) Challenge Problem, presented within this special issue, is provided hereafter. Overviews of the challenge problem workshop, workshop participants, and the problem statement are also included. Brief summations of teams' responses to the challenge problem are provided. Issues that arose throughout the responses that are deemed applicable to the general verification, validation, and uncertainty quantification (VVUQ) community are the main focal point of this paper. The discussion is oriented and organized into big picture comparison of data and model usage, VVUQ activities, and differentiating conceptual themes behind the teams' VVUQ strategies. Significant differences are noted in the teams' approaches toward all VVUQ activities, and those deemed most relevant are discussed. Beyond the specific details of VVUQ implementations, thematic concepts are found to create differences among the approaches; some of the major themes are discussed. Lastly, an encapsulation of the key contributions, the lessons learned, and advice for the future are presented.

View Accepted Manuscript (DOE)

Cite

Export

Save

Research Organization:: Sandia National Lab. (SNL-NM), Albuquerque, NM (United States)

Sponsoring Organization:: USDOE National Nuclear Security Administration (NNSA)

Grant/Contract Number:: AC04-94AL85000

OSTI ID:: 1238674

Report Number(s):: SAND-2015-10602J; 614814

Journal Information:: Journal of Verification, Validation and Uncertainty Quantification, Vol. 1, Issue 1; ISSN 2377-2158

Publisher:: ASMECopyright Statement

Country of Publication:: United States

Language:: English

References (17)

Introduction: The 2014 Sandia Verification and Validation Challenge Workshop Hu, Kenneth T.; Carnes, Brian; Romero, Vicente Journal of Verification, Validation and Uncertainty Quantification, Vol. 1, Issue 1 https://doi.org/10.1115/1.4032569	journal	February 2016
Alternative representations of epistemic uncertainty Helton, J. C.; Oberkampf, W. L. Reliability Engineering & System Safety, Vol. 85, Issue 1-3 https://doi.org/10.1016/j.ress.2004.03.001	journal	July 2004
Validation Challenge Workshop Hills, Richard G.; Pilch, Martin; Dowding, Kevin J. Computer Methods in Applied Mechanics and Engineering, Vol. 197, Issue 29-32 https://doi.org/10.1016/j.cma.2007.10.016	journal	May 2008
Sandia Verification and Validation Challenge Problem: A PCMM-Based Approach to Assessing Prediction Credibility Beghini, Lauren L.; Hough, Patricia D. Journal of Verification, Validation and Uncertainty Quantification, Vol. 1, Issue 1 https://doi.org/10.1115/1.4032369	journal	February 2016
Probability Bounds Analysis Applied to the Sandia Verification and Validation Challenge Problem Choudhary, Aniruddha; Voyles, Ian T.; Roy, Christopher J. Journal of Verification, Validation and Uncertainty Quantification, Vol. 1, Issue 1 https://doi.org/10.1115/1.4031285	journal	February 2016
Integrating Bayesian Calibration, Bias Correction, and Machine Learning for the 2014 Sandia Verification and Validation Challenge Problem Li, Wei; Chen, Shishi; Jiang, Zhen Journal of Verification, Validation and Uncertainty Quantification, Vol. 1, Issue 1 https://doi.org/10.1115/1.4031983	journal	February 2016
Reliability Analysis With Model Uncertainty Coupling With Parameter and Experiment Uncertainties: A Case Studyof 2014 Verification and Validation Challenge Problem Xi, Zhimin; Yang, Ren-Jye Journal of Verification, Validation and Uncertainty Quantification, Vol. 1, Issue 1 https://doi.org/10.1115/1.4031984	journal	December 2015
Bayesian Uncertainty Integration for Model Calibration, Validation, and Prediction Mullins, Joshua; Mahadevan, Sankaran Journal of Verification, Validation and Uncertainty Quantification, Vol. 1, Issue 1 https://doi.org/10.1115/1.4032371	journal	February 2016
Economic Analysis of Model Validation for a Challenge Problem Paez, Paul J.; Paez, Thomas L.; Hasselman, Timothy K. Journal of Verification, Validation and Uncertainty Quantification, Vol. 1, Issue 1 https://doi.org/10.1115/1.4032370	journal	February 2016
Efficient Global Reliability Analysis for Nonlinear Implicit Performance Functions Bichon, B. J.; Eldred, M. S.; Swiler, L. P. AIAA Journal, Vol. 46, Issue 10 https://doi.org/10.2514/1.34321	journal	October 2008
Model validation and predictive capability for the thermal challenge problem Ferson, Scott; Oberkampf, William L.; Ginzburg, Lev Computer Methods in Applied Mechanics and Engineering, Vol. 197, Issue 29-32 https://doi.org/10.1016/j.cma.2007.07.030	journal	May 2008
Bayesian calibration of computer models Kennedy, Marc C.; O'Hagan, Anthony Journal of the Royal Statistical Society: Series B (Statistical Methodology), Vol. 63, Issue 3 https://doi.org/10.1111/1467-9868.00294	journal	August 2001
Verification and validation in computational fluid dynamics Oberkampf, William L.; Trucano, Timothy G. Progress in Aerospace Sciences, Vol. 38, Issue 3 https://doi.org/10.1016/S0376-0421(02)00005-2	journal	April 2002
Summary from the epistemic uncertainty workshop: consensus amid diversity Ferson, Scott; Joslyn, Cliff A.; Helton, Jon C. Reliability Engineering & System Safety, Vol. 85, Issue 1-3 https://doi.org/10.1016/j.ress.2004.03.023	journal	July 2004
Review of code and solution verification procedures for computational simulation Roy, Christopher J. Journal of Computational Physics, Vol. 205, Issue 1 https://doi.org/10.1016/j.jcp.2004.10.036	journal	May 2005
Calibration, validation, and sensitivity analysis: What's what Trucano, T. G.; Swiler, L. P.; Igusa, T. Reliability Engineering & System Safety, Vol. 91, Issue 10-11 https://doi.org/10.1016/j.ress.2005.11.031	journal	October 2006
Selection of model discrepancy priors in Bayesian calibration Ling, You; Mullins, Joshua; Mahadevan, Sankaran Journal of Computational Physics, Vol. 276 https://doi.org/10.1016/j.jcp.2014.08.005	journal	November 2014

Cited By (1)

Model-Based Reliability Analysis With Both Model Uncertainty and Parameter Uncertainty Xi, Zhimin Journal of Mechanical Design, Vol. 141, Issue 5 https://doi.org/10.1115/1.4041946	journal	January 2019

Similar Records

Introduction: The 2014 Sandia Verification and Validation Challenge Workshop [The 2014 Sandia Verification and Validation Challenge Workshop]

Journal Article · Fri Feb 19 00:00:00 EST 2016 · Journal of Verification, Validation and Uncertainty Quantification · OSTI ID:1238674

Hu, Kenneth T.; Carnes, Brian; Romero, Vicente

The 2014 Sandia Verification and Validation Challenge: Problem statement

Journal Article · Mon Jan 18 00:00:00 EST 2016 · Journal of Verification, Validation and Uncertainty Quantification · OSTI ID:1238674

Hu, Kenneth; Orient, George

Developing State and National Evaluation Infrastructures- Guidance for the Challenges and Opportunities of EM&V

Conference · Fri Jun 24 00:00:00 EDT 2011 · OSTI ID:1238674

Schiller, Steven R; Goldman, Charles A

Related Subjects

42 ENGINEERING
97 MATHEMATICS AND COMPUTING
workshops
work spaces
teams
uncertainty

Title: Summary of the 2014 Sandia V&V Challenge Workshop

Citation Formats

References (17)

Cited By (1)

Similar Records

Related Subjects