skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Optimal test selection for prediction uncertainty reduction

Journal Article · · Journal of Verification, Validation and Uncertainty Quantification
DOI:https://doi.org/10.1115/1.4035204· OSTI ID:1335135
 [1];  [2];  [1]
  1. Sandia National Lab. (SNL-NM), Albuquerque, NM (United States)
  2. Vanderbilt Univ., Nashville, TN (United States)

Economic factors and experimental limitations often lead to sparse and/or imprecise data used for the calibration and validation of computational models. This paper addresses resource allocation for calibration and validation experiments, in order to maximize their effectiveness within given resource constraints. When observation data are used for model calibration, the quality of the inferred parameter descriptions is directly affected by the quality and quantity of the data. This paper characterizes parameter uncertainty within a probabilistic framework, which enables the uncertainty to be systematically reduced with additional data. The validation assessment is also uncertain in the presence of sparse and imprecise data; therefore, this paper proposes an approach for quantifying the resulting validation uncertainty. Since calibration and validation uncertainty affect the prediction of interest, the proposed framework explores the decision of cost versus importance of data in terms of the impact on the prediction uncertainty. Often, calibration and validation tests may be performed for different input scenarios, and this paper shows how the calibration and validation results from different conditions may be integrated into the prediction. Then, a constrained discrete optimization formulation that selects the number of tests of each type (calibration or validation at given input conditions) is proposed. Furthermore, the proposed test selection methodology is demonstrated on a microelectromechanical system (MEMS) example.

Research Organization:
Sandia National Lab. (SNL-NM), Albuquerque, NM (United States)
Sponsoring Organization:
USDOE National Nuclear Security Administration (NNSA)
Grant/Contract Number:
AC04-94AL85000
OSTI ID:
1335135
Report Number(s):
SAND-2015-8663J; 607411
Journal Information:
Journal of Verification, Validation and Uncertainty Quantification, Vol. 1, Issue 4; ISSN 2377-2158
Publisher:
ASMECopyright Statement
Country of Publication:
United States
Language:
English