skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Processing Aleatory and Epistemic Uncertainties in Experimental Data From Sparse Replicate Tests of Stochastic Systems for Real-Space Model Validation

Journal Article · · Journal of Verification, Validation and Uncertainty Quantification
DOI:https://doi.org/10.1115/1.4051069· OSTI ID:1782570
 [1];  [1]
  1. Sandia National Lab. (SNL-NM), Albuquerque, NM (United States)

This paper presents a practical methodology for propagating and processing uncertainties associated with random measurement and estimation errors (that vary from test-to-test) and systematic measurement and estimation errors (uncertain but similar from test-to-test) in inputs and outputs of replicate tests to characterize response variability of stochastically varying test units. Also treated are test condition control variability from test-to-test and sampling uncertainty due to limited numbers of replicate tests. These aleatory variabilities and epistemic uncertainties result in uncertainty on computed statistics of output response quantities. The methodology was developed in the context of processing experimental data for “real-space” (RS) model validation comparisons against model-predicted statistics and uncertainty thereof. The methodology is flexible and sufficient for many types of experimental and data uncertainty, offering the most extensive data uncertainty quantification (UQ) treatment of any model validation method the authors are aware of. It handles both interval and probabilistic uncertainty descriptions and can be performed with relatively little computational cost through use of simple and effective dimension- and order-adaptive polynomial response surfaces in a Monte Carlo (MC) uncertainty propagation approach. A key feature of the progressively upgraded response surfaces is that they enable estimation of propagation error contributed by the surrogate model. Sensitivity analysis of the relative contributions of the various uncertainty sources to the total uncertainty of statistical estimates is also presented. The methodologies are demonstrated on real experimental validation data involving all the mentioned sources and types of error and uncertainty in five replicate tests of pressure vessels heated and pressurized to failure. Simple spreadsheet procedures are used for all processing operations.

Research Organization:
Sandia National Lab. (SNL-NM), Albuquerque, NM (United States)
Sponsoring Organization:
USDOE National Nuclear Security Administration (NNSA)
Grant/Contract Number:
AC04-94AL85000; NA0003525
OSTI ID:
1782570
Alternate ID(s):
OSTI ID: 1787513
Report Number(s):
SAND-2021-0796J; SAND2020-8252J; 693579
Journal Information:
Journal of Verification, Validation and Uncertainty Quantification, Vol. 6, Issue 3; ISSN 2377-2158
Publisher:
ASMECopyright Statement
Country of Publication:
United States
Language:
English

References (9)

Comparison of Several Model Validation Conceptions against a “Real Space” End-to-End Approach journal April 2011
A Comparison of Methods for Representing and Aggregating Uncertainties Involving Sparsely Sampled Random Variables - More Results journal January 2013
Target output distribution and distribution of bias for statistical model validation given a limited number of test data journal July 2019
Uncertainties and CFD Code Validation journal December 1997
Simple Effective Conservative Treatment of Uncertainty From Sparse Samples of Random Variables and Functions
  • Romero, Vicente J.; Schroeder, Benjamin B.; Dempsey, James F.
  • ASCE-ASME J Risk and Uncert in Engrg Sys Part B Mech Engrg, Vol. 4, Issue 4 https://doi.org/10.1115/1.4039558
journal April 2018
A framework of model validation and virtual product qualification with limited experimental data based on statistical inference journal October 2014
Bayesian Uncertainty Integration for Model Calibration, Validation, and Prediction journal February 2016
Application of a Versatile "Real-Space" Validation Methodology to a Fire Model journal October 2010
Measures of agreement between computation and experiment: Validation metrics journal September 2006