Convergence of Probability Densities Using Approximate Models for Forward and Inverse Problems in Uncertainty Quantification
Abstract
Here, we analyze the convergence of probability density functions utilizing approximate models for both forward and inverse problems. We consider the standard forward uncertainty quantification problem where an assumed probability density on parameters is propagated through the approximate model to produce a probability density, often called a push-forward probability density, on a set of quantities of interest (QoI). The inverse problem considered in this paper seeks to update an initial probability density assumed on model input parameters such that the subsequent push-forward of this updated density through the parameter-to-QoI map matches a given probability density on the QoI. We prove that the densities obtained from solving the forward and inverse problems, using approximate models, converge to the true densities as the approximate models converge to the true models. Numerical results are presented to demonstrate convergence rates of densities for sparse grid approximations of parameter-to-QoI maps and standard spatial and temporal discretizations of PDEs and ODEs.
- Authors:
-
- Univ. of Colorado, Boulder, CO (United States)
- Sandia National Lab. (SNL-NM), Albuquerque, NM (United States)
- Publication Date:
- Research Org.:
- Sandia National Lab. (SNL-NM), Albuquerque, NM (United States)
- Sponsoring Org.:
- USDOE National Nuclear Security Administration (NNSA); National Science Foundation (NSF)
- OSTI Identifier:
- 1479491
- Alternate Identifier(s):
- OSTI ID: 1595429
- Report Number(s):
- SAND-2018-6887J; SAND-2020-0021J
Journal ID: ISSN 1064-8275; 664970
- Grant/Contract Number:
- AC04-94AL85000; DMS-1818941
- Resource Type:
- Accepted Manuscript
- Journal Name:
- SIAM Journal on Scientific Computing
- Additional Journal Information:
- Journal Volume: 40; Journal Issue: 5; Journal ID: ISSN 1064-8275
- Publisher:
- SIAM
- Country of Publication:
- United States
- Language:
- English
- Subject:
- 97 MATHEMATICS AND COMPUTING; inverse problems; uncertainty quantification; density estimation; surrogate modeling; response surface approximations; discretization errors; LP convergence; approximate modeling
Citation Formats
Butler, Troy, Jakeman, John Davis, and Wildey, Timothy Michael. Convergence of Probability Densities Using Approximate Models for Forward and Inverse Problems in Uncertainty Quantification. United States: N. p., 2018.
Web. doi:10.1137/18M1181675.
Butler, Troy, Jakeman, John Davis, & Wildey, Timothy Michael. Convergence of Probability Densities Using Approximate Models for Forward and Inverse Problems in Uncertainty Quantification. United States. https://doi.org/10.1137/18M1181675
Butler, Troy, Jakeman, John Davis, and Wildey, Timothy Michael. Thu .
"Convergence of Probability Densities Using Approximate Models for Forward and Inverse Problems in Uncertainty Quantification". United States. https://doi.org/10.1137/18M1181675. https://www.osti.gov/servlets/purl/1479491.
@article{osti_1479491,
title = {Convergence of Probability Densities Using Approximate Models for Forward and Inverse Problems in Uncertainty Quantification},
author = {Butler, Troy and Jakeman, John Davis and Wildey, Timothy Michael},
abstractNote = {Here, we analyze the convergence of probability density functions utilizing approximate models for both forward and inverse problems. We consider the standard forward uncertainty quantification problem where an assumed probability density on parameters is propagated through the approximate model to produce a probability density, often called a push-forward probability density, on a set of quantities of interest (QoI). The inverse problem considered in this paper seeks to update an initial probability density assumed on model input parameters such that the subsequent push-forward of this updated density through the parameter-to-QoI map matches a given probability density on the QoI. We prove that the densities obtained from solving the forward and inverse problems, using approximate models, converge to the true densities as the approximate models converge to the true models. Numerical results are presented to demonstrate convergence rates of densities for sparse grid approximations of parameter-to-QoI maps and standard spatial and temporal discretizations of PDEs and ODEs.},
doi = {10.1137/18M1181675},
journal = {SIAM Journal on Scientific Computing},
number = 5,
volume = 40,
place = {United States},
year = {Thu Oct 18 00:00:00 EDT 2018},
month = {Thu Oct 18 00:00:00 EDT 2018}
}
Web of Science
Figures / Tables:
Works referenced in this record:
An optimal control approach to a posteriori error estimation in finite element methods
journal, May 2001
- Becker, Roland; Rannacher, Rolf
- Acta Numerica, Vol. 10
A Converse to Scheffe's Theorem
journal, March 1985
- Boos, Dennis D.
- The Annals of Statistics, Vol. 13, Issue 1
Error Decomposition and Adaptivity for Response Surface Approximations from PDEs with Parametric Uncertainty
journal, January 2015
- Bryant, C. M.; Prudhomme, S.; Wildey, T.
- SIAM/ASA Journal on Uncertainty Quantification, Vol. 3, Issue 1
A Posteriori Error Analysis of Parameterized Linear Systems Using Spectral Methods
journal, January 2012
- Butler, T.; Constantine, P.; Wildey, T.
- SIAM Journal on Matrix Analysis and Applications, Vol. 33, Issue 1
A Posteriori Error Analysis of Stochastic Differential Equations Using Polynomial Chaos Expansions
journal, January 2011
- Butler, T.; Dawson, C.; Wildey, T.
- SIAM Journal on Scientific Computing, Vol. 33, Issue 3
Propagation of Uncertainties Using Improved Surrogate Models
journal, January 2013
- Butler, T.; Dawson, C.; Wildey, T.
- SIAM/ASA Journal on Uncertainty Quantification, Vol. 1, Issue 1
Combining Push-Forward Measures and Bayes' Rule to Construct Consistent Solutions to Stochastic Inverse Problems
journal, January 2018
- Butler, T.; Jakeman, J.; Wildey, T.
- SIAM Journal on Scientific Computing, Vol. 40, Issue 2
Sparse-grid, reduced-basis Bayesian inversion: Nonaffine-parametric nonlinear equations
journal, July 2016
- Chen, Peng; Schwab, Christoph
- Journal of Computational Physics, Vol. 316
Stochastic collocation and mixed finite elements for flow in porous media
journal, August 2008
- Ganis, Benjamin; Klie, Hector; Wheeler, Mary F.
- Computer Methods in Applied Mechanics and Engineering, Vol. 197, Issue 43-44
Adjoint methods for PDEs: a posteriori error analysis and postprocessing by duality
journal, January 2002
- Giles, Michael B.; Süli, Endre
- Acta Numerica, Vol. 11
Uniform Convergence Rates for Kernel Estimation with Dependent data
journal, February 2008
- Hansen, Bruce E.
- Econometric Theory, Vol. 24, Issue 3
Numerical approach for quantification of epistemic uncertainty
journal, June 2010
- Jakeman, John; Eldred, Michael; Xiu, Dongbin
- Journal of Computational Physics, Vol. 229, Issue 12
Enhancing adaptive sparse grid approximations and improving refinement strategies using adjoint-based a posteriori error estimates
journal, January 2015
- Jakeman, J. D.; Wildey, T.
- Journal of Computational Physics, Vol. 280
Bayesian calibration of computer models
journal, August 2001
- Kennedy, Marc C.; O'Hagan, Anthony
- Journal of the Royal Statistical Society: Series B (Statistical Methodology), Vol. 63, Issue 3
On Information and Sufficiency
journal, March 1951
- Kullback, S.; Leibler, R. A.
- The Annals of Mathematical Statistics, Vol. 22, Issue 1
An adaptive hierarchical sparse grid collocation algorithm for the solution of stochastic differential equations
journal, May 2009
- Ma, Xiang; Zabaras, Nicholas
- Journal of Computational Physics, Vol. 228, Issue 8
A Sparse Grid Stochastic Collocation Method for Partial Differential Equations with Random Input Data
journal, January 2008
- Nobile, F.; Tempone, R.; Webster, C. G.
- SIAM Journal on Numerical Analysis, Vol. 46, Issue 5
Goal-oriented error estimation and adaptivity for the finite element method
journal, March 2001
- Oden, J. T.; Prudhomme, S.
- Computers & Mathematics with Applications, Vol. 41, Issue 5-6
Interpolation of spatial data – A stochastic or a deterministic problem?
journal, February 2013
- Scheuerer, M.; Schaback, R.; Schlather, M.
- European Journal of Applied Mathematics, Vol. 24, Issue 4
Karhunen–Loève approximation of random fields by generalized fast multipole methods
journal, September 2006
- Schwab, Christoph; Todor, Radu Alexandru
- Journal of Computational Physics, Vol. 217, Issue 1
On a Converse to Scheffe's Theorem
journal, September 1986
- Sweeting, T. J.
- The Annals of Statistics, Vol. 14, Issue 3
Variable Kernel Density Estimation
journal, September 1992
- Terrell, George R.; Scott, David W.
- The Annals of Statistics, Vol. 20, Issue 3
A multiscale preconditioner for stochastic mortar mixed finite elements
journal, February 2011
- Wheeler, Mary F.; Wildey, Tim; Yotov, Ivan
- Computer Methods in Applied Mechanics and Engineering, Vol. 200, Issue 9-12
The Wiener--Askey Polynomial Chaos for Stochastic Differential Equations
journal, January 2002
- Xiu, Dongbin; Karniadakis, George Em
- SIAM Journal on Scientific Computing, Vol. 24, Issue 2
An efficient, high-order perturbation approach for flow in random porous media via Karhunen–Loève and polynomial expansions
journal, March 2004
- Zhang, Dongxiao; Lu, Zhiming
- Journal of Computational Physics, Vol. 194, Issue 2
Stochastic collocation and mixed finite elements for flow in porous media
journal, August 2008
- Ganis, Benjamin; Klie, Hector; Wheeler, Mary F.
- Computer Methods in Applied Mechanics and Engineering, Vol. 197, Issue 43-44
An adaptive hierarchical sparse grid collocation algorithm for the solution of stochastic differential equations
journal, May 2009
- Ma, Xiang; Zabaras, Nicholas
- Journal of Computational Physics, Vol. 228, Issue 8
Numerical approach for quantification of epistemic uncertainty
journal, June 2010
- Jakeman, John; Eldred, Michael; Xiu, Dongbin
- Journal of Computational Physics, Vol. 229, Issue 12
Utilizing Adjoint-Based Error Estimates for Surrogate Models to Accurately Predict Probabilities of Events
journal, January 2018
- Butler, Troy; Wildey, Timothy
- International Journal for Uncertainty Quantification, Vol. 8, Issue 2
Enhancing adaptive sparse grid approximations and improving refinement strategies using adjoint-based a posteriori error estimates
text, January 2014
- Jakeman, John D.; Wildey, Timothy
- arXiv
Works referencing / citing this record:
Adaptive multi‐index collocation for uncertainty quantification and sensitivity analysis
journal, November 2019
- Jakeman, John D.; Eldred, Michael S.; Geraci, Gianluca
- International Journal for Numerical Methods in Engineering, Vol. 121, Issue 6
Adaptive multi‐index collocation for uncertainty quantification and sensitivity analysis
journal, August 2020
- Jakeman, John D.; Eldred, Michael S.; Geraci, Gianluca
- International Journal for Numerical Methods in Engineering, Vol. 121, Issue 19
Adaptive multi-index collocation for uncertainty quantification and sensitivity analysis
report, November 2019
- Jakeman, John Davis; Eldred, Michael S.; Geraci, G.
Solving Stochastic Inverse Problems for Property–Structure Linkages Using Data-Consistent Inversion and Machine Learning
journal, November 2020
- Tran, Anh; Wildey, Tim
- JOM, Vol. 73, Issue 1
Adaptive sampling-based quadrature rules for efficient Bayesian prediction
text, January 2019
- Bos, L. M. M. van den; Sanderse, B.; Bierbooms, W. A. A. M.
- arXiv
Convergence of Probability Densities using Approximate Models for Forward and Inverse Problems in Uncertainty Quantification: Extensions to $L^p$
preprint, January 2020
- Butler, Troy; Wildey, Tim; Zhang, Wenjuan
- arXiv
Figures / Tables found in this record: