skip to main content


Title: Optimal test selection for prediction uncertainty reduction

Economic factors and experimental limitations often lead to sparse and/or imprecise data used for the calibration and validation of computational models. This paper addresses resource allocation for calibration and validation experiments, in order to maximize their effectiveness within given resource constraints. When observation data are used for model calibration, the quality of the inferred parameter descriptions is directly affected by the quality and quantity of the data. This paper characterizes parameter uncertainty within a probabilistic framework, which enables the uncertainty to be systematically reduced with additional data. The validation assessment is also uncertain in the presence of sparse and imprecise data; therefore, this paper proposes an approach for quantifying the resulting validation uncertainty. Since calibration and validation uncertainty affect the prediction of interest, the proposed framework explores the decision of cost versus importance of data in terms of the impact on the prediction uncertainty. Often, calibration and validation tests may be performed for different input scenarios, and this paper shows how the calibration and validation results from different conditions may be integrated into the prediction. Then, a constrained discrete optimization formulation that selects the number of tests of each type (calibration or validation at given input conditions) is proposed. Furthermore,more » the proposed test selection methodology is demonstrated on a microelectromechanical system (MEMS) example.« less
 [1] ;  [2] ;  [1]
  1. Sandia National Lab. (SNL-NM), Albuquerque, NM (United States)
  2. Vanderbilt Univ., Nashville, TN (United States)
Publication Date:
Report Number(s):
Journal ID: ISSN 2377-2158; 607411
Grant/Contract Number:
Accepted Manuscript
Journal Name:
Journal of Verification, Validation and Uncertainty Quantification
Additional Journal Information:
Journal Volume: 1; Journal Issue: 4; Journal ID: ISSN 2377-2158
Research Org:
Sandia National Lab. (SNL-NM), Albuquerque, NM (United States)
Sponsoring Org:
USDOE National Nuclear Security Administration (NNSA)
Country of Publication:
United States
97 MATHEMATICS AND COMPUTING; optimization; calibration; uncertainty; reliability
OSTI Identifier: