Optimal experimental design for prediction based on push-forward probability measures
Abstract
Incorporating experimental data is essential for increasing the credibility of simulation-aided decision making and design. This paper presents a method which uses a computational model to guide the optimal acquisition of experimental data to produce data-informed predictions of quantities of interest (QoI). Many strategies for optimal experimental design (OED) select data that maximize some utility that measures the reduction in uncertainty of uncertain model parameters, for example the expected information gain between prior and posterior distributions of these parameters. In this paper, we seek to maximize the expected information gained from the pushforward of an initial (prior) density to the push-forward of the updated (posterior) density through the parameter-to-prediction map. The formulation presented is based upon the solution of a specific class of stochastic inverse problems which seeks a probability density that is consistent with the model and the data in the sense that the push-forward of this density through the parameter-to-observable map matches a target density on the observable data. While this stochastic inverse problem forms the mathematical basis for our approach, we develop a one-step algorithm, focused on push-forward probability measures, that leverages inference-for-prediction to bypass constructing the solution to the stochastic inverse problem. A number of numericalmore »
- Authors:
-
- Univ. of Colorado, Denver, CO (United States)
- Sandia National Lab. (SNL-NM), Albuquerque, NM (United States)
- Publication Date:
- Research Org.:
- Sandia National Lab. (SNL-NM), Albuquerque, NM (United States)
- Sponsoring Org.:
- USDOE National Nuclear Security Administration (NNSA)
- OSTI Identifier:
- 1630281
- Alternate Identifier(s):
- OSTI ID: 1630473
- Report Number(s):
- SAND2020-4951J
Journal ID: ISSN 0021-9991; 686011; TRN: US2200651
- Grant/Contract Number:
- AC04-94AL85000
- Resource Type:
- Journal Article: Accepted Manuscript
- Journal Name:
- Journal of Computational Physics
- Additional Journal Information:
- Journal Volume: 416; Journal Issue: C; Journal ID: ISSN 0021-9991
- Publisher:
- Elsevier
- Country of Publication:
- United States
- Language:
- English
- Subject:
- 71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSICS
Citation Formats
Butler, T., Jakeman, J. D., and Wildey, T.. Optimal experimental design for prediction based on push-forward probability measures. United States: N. p., 2020.
Web. doi:10.1016/j.jcp.2020.109518.
Butler, T., Jakeman, J. D., & Wildey, T.. Optimal experimental design for prediction based on push-forward probability measures. United States. https://doi.org/10.1016/j.jcp.2020.109518
Butler, T., Jakeman, J. D., and Wildey, T.. 2020.
"Optimal experimental design for prediction based on push-forward probability measures". United States. https://doi.org/10.1016/j.jcp.2020.109518. https://www.osti.gov/servlets/purl/1630281.
@article{osti_1630281,
title = {Optimal experimental design for prediction based on push-forward probability measures},
author = {Butler, T. and Jakeman, J. D. and Wildey, T.},
abstractNote = {Incorporating experimental data is essential for increasing the credibility of simulation-aided decision making and design. This paper presents a method which uses a computational model to guide the optimal acquisition of experimental data to produce data-informed predictions of quantities of interest (QoI). Many strategies for optimal experimental design (OED) select data that maximize some utility that measures the reduction in uncertainty of uncertain model parameters, for example the expected information gain between prior and posterior distributions of these parameters. In this paper, we seek to maximize the expected information gained from the pushforward of an initial (prior) density to the push-forward of the updated (posterior) density through the parameter-to-prediction map. The formulation presented is based upon the solution of a specific class of stochastic inverse problems which seeks a probability density that is consistent with the model and the data in the sense that the push-forward of this density through the parameter-to-observable map matches a target density on the observable data. While this stochastic inverse problem forms the mathematical basis for our approach, we develop a one-step algorithm, focused on push-forward probability measures, that leverages inference-for-prediction to bypass constructing the solution to the stochastic inverse problem. A number of numerical results are presented to demonstrate the utility of this optimal experimental design for prediction and facilitate comparison of our approach with traditional OED.},
doi = {10.1016/j.jcp.2020.109518},
url = {https://www.osti.gov/biblio/1630281},
journal = {Journal of Computational Physics},
issn = {0021-9991},
number = C,
volume = 416,
place = {United States},
year = {2020},
month = {5}
}
Works referenced in this record:
Goal-Oriented Inference: Approach, Linear Theory, and Application to Advection Diffusion
journal, January 2012
- Lieberman, Chad; Willcox, Karen
- SIAM Journal on Scientific Computing, Vol. 34, Issue 4
Efficient D-Optimal Design of Experiments for Infinite-Dimensional Bayesian Linear Inverse Problems
journal, January 2018
- Alexanderian, Alen; Saibaba, Arvind K.
- SIAM Journal on Scientific Computing, Vol. 40, Issue 5
A Simple Mesh Generator in MATLAB
journal, January 2004
- Persson, Per-Olof; Strang, Gilbert
- SIAM Review, Vol. 46, Issue 2
A-Optimal Design of Experiments for Infinite-Dimensional Bayesian Linear Inverse Problems with Regularized $\ell_0$-Sparsification
journal, January 2014
- Alexanderian, Alen; Petra, Noemi; Stadler, Georg
- SIAM Journal on Scientific Computing, Vol. 36, Issue 5
Goal-oriented optimal design of experiments for large-scale Bayesian linear inverse problems
journal, July 2018
- Attia, Ahmed; Alexanderian, Alen; Saibaba, Arvind K.
- Inverse Problems, Vol. 34, Issue 9
Fast estimation of expected information gains for Bayesian experimental designs based on Laplace approximations
journal, June 2013
- Long, Quan; Scavino, Marco; Tempone, Raúl
- Computer Methods in Applied Mechanics and Engineering, Vol. 259
Numerical methods for A-optimal designs with a sparsity constraint for ill-posed inverse problems
journal, April 2011
- Haber, Eldad; Magnant, Zhuojun; Lucero, Christian
- Computational Optimization and Applications, Vol. 52, Issue 1
Nonlinear Goal-Oriented Bayesian Inference: Application to Carbon Capture and Storage
journal, January 2014
- Lieberman, Chad; Willcox, Karen
- SIAM Journal on Scientific Computing, Vol. 36, Issue 3
Combining Push-Forward Measures and Bayes' Rule to Construct Consistent Solutions to Stochastic Inverse Problems
journal, January 2018
- Butler, T.; Jakeman, J.; Wildey, T.
- SIAM Journal on Scientific Computing, Vol. 40, Issue 2
Convergence of Probability Densities Using Approximate Models for Forward and Inverse Problems in Uncertainty Quantification
journal, January 2018
- Butler, T.; Jakeman, J.; Wildey, T.
- SIAM Journal on Scientific Computing, Vol. 40, Issue 5
Numerical methods for the design of large-scale nonlinear discrete ill-posed inverse problems
journal, December 2009
- Haber, E.; Horesh, L.; Tenorio, L.
- Inverse Problems, Vol. 26, Issue 2
Optimal Bayesian Design by Inhomogeneous Markov Chain Simulation
journal, September 2004
- Müller, Peter; Sansó, Bruno; De Iorio, Maria
- Journal of the American Statistical Association, Vol. 99, Issue 467
Rényi Divergence and Kullback-Leibler Divergence
journal, July 2014
- van Erven, Tim; Harremoes, Peter
- IEEE Transactions on Information Theory, Vol. 60, Issue 7
A Fast and Scalable Method for A-Optimal Design of Experiments for Infinite-dimensional Bayesian Nonlinear Inverse Problems
journal, January 2016
- Alexanderian, Alen; Petra, Noemi; Stadler, Georg
- SIAM Journal on Scientific Computing, Vol. 38, Issue 1
Numerical methods for optimum experimental design in DAE systems
journal, August 2000
- Bauer, Irene; Bock, Hans Georg; Körkel, Stefan
- Journal of Computational and Applied Mathematics, Vol. 120, Issue 1-2
Bayesian Experimental Design: A Review
journal, August 1995
- Chaloner, Kathryn; Verdinelli, Isabella
- Statistical Science, Vol. 10, Issue 3
Simulation-Based Optimal Design Using a Response Variance Criterion
journal, January 2012
- Solonen, Antti; Haario, Heikki; Laine, Marko
- Journal of Computational and Graphical Statistics, Vol. 21, Issue 1
Simulation-based optimal Bayesian experimental design for nonlinear systems
journal, January 2013
- Huan, Xun; Marzouk, Youssef M.
- Journal of Computational Physics, Vol. 232, Issue 1
A Laplace method for under-determined Bayesian optimal experimental designs
journal, March 2015
- Long, Quan; Scavino, Marco; Tempone, Raúl
- Computer Methods in Applied Mechanics and Engineering, Vol. 285