skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Optimal experimental design for prediction based on push-forward probability measures

Abstract

Incorporating experimental data is essential for increasing the credibility of simulation-aided decision making and design. This paper presents a method which uses a computational model to guide the optimal acquisition of experimental data to produce data-informed predictions of quantities of interest (QoI). Many strategies for optimal experimental design (OED) select data that maximize some utility that measures the reduction in uncertainty of uncertain model parameters, for example the expected information gain between prior and posterior distributions of these parameters. In this paper, we seek to maximize the expected information gained from the pushforward of an initial (prior) density to the push-forward of the updated (posterior) density through the parameter-to-prediction map. The formulation presented is based upon the solution of a specific class of stochastic inverse problems which seeks a probability density that is consistent with the model and the data in the sense that the push-forward of this density through the parameter-to-observable map matches a target density on the observable data. While this stochastic inverse problem forms the mathematical basis for our approach, we develop a one-step algorithm, focused on push-forward probability measures, that leverages inference-for-prediction to bypass constructing the solution to the stochastic inverse problem. A number of numericalmore » results are presented to demonstrate the utility of this optimal experimental design for prediction and facilitate comparison of our approach with traditional OED.« less

Authors:
 [1]; ORCiD logo [2];  [2]
  1. Univ. of Colorado, Denver, CO (United States)
  2. Sandia National Lab. (SNL-NM), Albuquerque, NM (United States)
Publication Date:
Research Org.:
Sandia National Lab. (SNL-NM), Albuquerque, NM (United States)
Sponsoring Org.:
USDOE National Nuclear Security Administration (NNSA)
OSTI Identifier:
1630281
Alternate Identifier(s):
OSTI ID: 1630473
Report Number(s):
SAND2020-4951J
Journal ID: ISSN 0021-9991; 686011; TRN: US2200651
Grant/Contract Number:  
AC04-94AL85000
Resource Type:
Journal Article: Accepted Manuscript
Journal Name:
Journal of Computational Physics
Additional Journal Information:
Journal Volume: 416; Journal Issue: C; Journal ID: ISSN 0021-9991
Publisher:
Elsevier
Country of Publication:
United States
Language:
English
Subject:
71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSICS

Citation Formats

Butler, T., Jakeman, J. D., and Wildey, T.. Optimal experimental design for prediction based on push-forward probability measures. United States: N. p., 2020. Web. doi:10.1016/j.jcp.2020.109518.
Butler, T., Jakeman, J. D., & Wildey, T.. Optimal experimental design for prediction based on push-forward probability measures. United States. https://doi.org/10.1016/j.jcp.2020.109518
Butler, T., Jakeman, J. D., and Wildey, T.. 2020. "Optimal experimental design for prediction based on push-forward probability measures". United States. https://doi.org/10.1016/j.jcp.2020.109518. https://www.osti.gov/servlets/purl/1630281.
@article{osti_1630281,
title = {Optimal experimental design for prediction based on push-forward probability measures},
author = {Butler, T. and Jakeman, J. D. and Wildey, T.},
abstractNote = {Incorporating experimental data is essential for increasing the credibility of simulation-aided decision making and design. This paper presents a method which uses a computational model to guide the optimal acquisition of experimental data to produce data-informed predictions of quantities of interest (QoI). Many strategies for optimal experimental design (OED) select data that maximize some utility that measures the reduction in uncertainty of uncertain model parameters, for example the expected information gain between prior and posterior distributions of these parameters. In this paper, we seek to maximize the expected information gained from the pushforward of an initial (prior) density to the push-forward of the updated (posterior) density through the parameter-to-prediction map. The formulation presented is based upon the solution of a specific class of stochastic inverse problems which seeks a probability density that is consistent with the model and the data in the sense that the push-forward of this density through the parameter-to-observable map matches a target density on the observable data. While this stochastic inverse problem forms the mathematical basis for our approach, we develop a one-step algorithm, focused on push-forward probability measures, that leverages inference-for-prediction to bypass constructing the solution to the stochastic inverse problem. A number of numerical results are presented to demonstrate the utility of this optimal experimental design for prediction and facilitate comparison of our approach with traditional OED.},
doi = {10.1016/j.jcp.2020.109518},
url = {https://www.osti.gov/biblio/1630281}, journal = {Journal of Computational Physics},
issn = {0021-9991},
number = C,
volume = 416,
place = {United States},
year = {2020},
month = {5}
}

Works referenced in this record:

Goal-Oriented Inference: Approach, Linear Theory, and Application to Advection Diffusion
journal, January 2012


Efficient D-Optimal Design of Experiments for Infinite-Dimensional Bayesian Linear Inverse Problems
journal, January 2018


A Simple Mesh Generator in MATLAB
journal, January 2004


A-Optimal Design of Experiments for Infinite-Dimensional Bayesian Linear Inverse Problems with Regularized $\ell_0$-Sparsification
journal, January 2014


Goal-oriented optimal design of experiments for large-scale Bayesian linear inverse problems
journal, July 2018


Fast estimation of expected information gains for Bayesian experimental designs based on Laplace approximations
journal, June 2013


Numerical methods for A-optimal designs with a sparsity constraint for ill-posed inverse problems
journal, April 2011


Nonlinear Goal-Oriented Bayesian Inference: Application to Carbon Capture and Storage
journal, January 2014


Combining Push-Forward Measures and Bayes' Rule to Construct Consistent Solutions to Stochastic Inverse Problems
journal, January 2018


Convergence of Probability Densities Using Approximate Models for Forward and Inverse Problems in Uncertainty Quantification
journal, January 2018


Numerical methods for the design of large-scale nonlinear discrete ill-posed inverse problems
journal, December 2009


Optimal Bayesian Design by Inhomogeneous Markov Chain Simulation
journal, September 2004


Rényi Divergence and Kullback-Leibler Divergence
journal, July 2014


A Fast and Scalable Method for A-Optimal Design of Experiments for Infinite-dimensional Bayesian Nonlinear Inverse Problems
journal, January 2016


Numerical methods for optimum experimental design in DAE systems
journal, August 2000


Bayesian Experimental Design: A Review
journal, August 1995


Simulation-Based Optimal Design Using a Response Variance Criterion
journal, January 2012


Simulation-based optimal Bayesian experimental design for nonlinear systems
journal, January 2013


A Laplace method for under-determined Bayesian optimal experimental designs
journal, March 2015