DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Convergence of Probability Densities Using Approximate Models for Forward and Inverse Problems in Uncertainty Quantification

Abstract

Here, we analyze the convergence of probability density functions utilizing approximate models for both forward and inverse problems. We consider the standard forward uncertainty quantification problem where an assumed probability density on parameters is propagated through the approximate model to produce a probability density, often called a push-forward probability density, on a set of quantities of interest (QoI). The inverse problem considered in this paper seeks to update an initial probability density assumed on model input parameters such that the subsequent push-forward of this updated density through the parameter-to-QoI map matches a given probability density on the QoI. We prove that the densities obtained from solving the forward and inverse problems, using approximate models, converge to the true densities as the approximate models converge to the true models. Numerical results are presented to demonstrate convergence rates of densities for sparse grid approximations of parameter-to-QoI maps and standard spatial and temporal discretizations of PDEs and ODEs.

Authors:
 [1];  [2];  [2]
  1. Univ. of Colorado, Boulder, CO (United States)
  2. Sandia National Lab. (SNL-NM), Albuquerque, NM (United States)
Publication Date:
Research Org.:
Sandia National Lab. (SNL-NM), Albuquerque, NM (United States)
Sponsoring Org.:
USDOE National Nuclear Security Administration (NNSA); National Science Foundation (NSF)
OSTI Identifier:
1479491
Alternate Identifier(s):
OSTI ID: 1595429
Report Number(s):
SAND-2018-6887J; SAND-2020-0021J
Journal ID: ISSN 1064-8275; 664970
Grant/Contract Number:  
AC04-94AL85000; DMS-1818941
Resource Type:
Accepted Manuscript
Journal Name:
SIAM Journal on Scientific Computing
Additional Journal Information:
Journal Volume: 40; Journal Issue: 5; Journal ID: ISSN 1064-8275
Publisher:
SIAM
Country of Publication:
United States
Language:
English
Subject:
97 MATHEMATICS AND COMPUTING; inverse problems; uncertainty quantification; density estimation; surrogate modeling; response surface approximations; discretization errors; LP convergence; approximate modeling

Citation Formats

Butler, Troy, Jakeman, John Davis, and Wildey, Timothy Michael. Convergence of Probability Densities Using Approximate Models for Forward and Inverse Problems in Uncertainty Quantification. United States: N. p., 2018. Web. doi:10.1137/18M1181675.
Butler, Troy, Jakeman, John Davis, & Wildey, Timothy Michael. Convergence of Probability Densities Using Approximate Models for Forward and Inverse Problems in Uncertainty Quantification. United States. https://doi.org/10.1137/18M1181675
Butler, Troy, Jakeman, John Davis, and Wildey, Timothy Michael. Thu . "Convergence of Probability Densities Using Approximate Models for Forward and Inverse Problems in Uncertainty Quantification". United States. https://doi.org/10.1137/18M1181675. https://www.osti.gov/servlets/purl/1479491.
@article{osti_1479491,
title = {Convergence of Probability Densities Using Approximate Models for Forward and Inverse Problems in Uncertainty Quantification},
author = {Butler, Troy and Jakeman, John Davis and Wildey, Timothy Michael},
abstractNote = {Here, we analyze the convergence of probability density functions utilizing approximate models for both forward and inverse problems. We consider the standard forward uncertainty quantification problem where an assumed probability density on parameters is propagated through the approximate model to produce a probability density, often called a push-forward probability density, on a set of quantities of interest (QoI). The inverse problem considered in this paper seeks to update an initial probability density assumed on model input parameters such that the subsequent push-forward of this updated density through the parameter-to-QoI map matches a given probability density on the QoI. We prove that the densities obtained from solving the forward and inverse problems, using approximate models, converge to the true densities as the approximate models converge to the true models. Numerical results are presented to demonstrate convergence rates of densities for sparse grid approximations of parameter-to-QoI maps and standard spatial and temporal discretizations of PDEs and ODEs.},
doi = {10.1137/18M1181675},
journal = {SIAM Journal on Scientific Computing},
number = 5,
volume = 40,
place = {United States},
year = {Thu Oct 18 00:00:00 EDT 2018},
month = {Thu Oct 18 00:00:00 EDT 2018}
}

Journal Article:
Free Publicly Available Full Text
Publisher's Version of Record

Citation Metrics:
Cited by: 11 works
Citation information provided by
Web of Science

Figures / Tables:

Figure 4.1 Figure 4.1: The level-4 sparse grid approximation of the $Q$o$I$ (left), the level-8 sparse grid approximation of the $Q$o$I$ (middle), and the reference solution (right).

Save / Share:

Works referenced in this record:

An optimal control approach to a posteriori error estimation in finite element methods
journal, May 2001


A Converse to Scheffe's Theorem
journal, March 1985


Error Decomposition and Adaptivity for Response Surface Approximations from PDEs with Parametric Uncertainty
journal, January 2015

  • Bryant, C. M.; Prudhomme, S.; Wildey, T.
  • SIAM/ASA Journal on Uncertainty Quantification, Vol. 3, Issue 1
  • DOI: 10.1137/140962632

Sparse grids
journal, May 2004


A Posteriori Error Analysis of Parameterized Linear Systems Using Spectral Methods
journal, January 2012

  • Butler, T.; Constantine, P.; Wildey, T.
  • SIAM Journal on Matrix Analysis and Applications, Vol. 33, Issue 1
  • DOI: 10.1137/110840522

A Posteriori Error Analysis of Stochastic Differential Equations Using Polynomial Chaos Expansions
journal, January 2011

  • Butler, T.; Dawson, C.; Wildey, T.
  • SIAM Journal on Scientific Computing, Vol. 33, Issue 3
  • DOI: 10.1137/100795760

Propagation of Uncertainties Using Improved Surrogate Models
journal, January 2013

  • Butler, T.; Dawson, C.; Wildey, T.
  • SIAM/ASA Journal on Uncertainty Quantification, Vol. 1, Issue 1
  • DOI: 10.1137/120888399

Combining Push-Forward Measures and Bayes' Rule to Construct Consistent Solutions to Stochastic Inverse Problems
journal, January 2018

  • Butler, T.; Jakeman, J.; Wildey, T.
  • SIAM Journal on Scientific Computing, Vol. 40, Issue 2
  • DOI: 10.1137/16M1087229

Sparse-grid, reduced-basis Bayesian inversion: Nonaffine-parametric nonlinear equations
journal, July 2016


Stochastic collocation and mixed finite elements for flow in porous media
journal, August 2008

  • Ganis, Benjamin; Klie, Hector; Wheeler, Mary F.
  • Computer Methods in Applied Mechanics and Engineering, Vol. 197, Issue 43-44
  • DOI: 10.1016/j.cma.2008.03.025

Adjoint methods for PDEs: a posteriori error analysis and postprocessing by duality
journal, January 2002


Uniform Convergence Rates for Kernel Estimation with Dependent data
journal, February 2008


Numerical approach for quantification of epistemic uncertainty
journal, June 2010

  • Jakeman, John; Eldred, Michael; Xiu, Dongbin
  • Journal of Computational Physics, Vol. 229, Issue 12
  • DOI: 10.1016/j.jcp.2010.03.003

Bayesian calibration of computer models
journal, August 2001

  • Kennedy, Marc C.; O'Hagan, Anthony
  • Journal of the Royal Statistical Society: Series B (Statistical Methodology), Vol. 63, Issue 3
  • DOI: 10.1111/1467-9868.00294

On Information and Sufficiency
journal, March 1951

  • Kullback, S.; Leibler, R. A.
  • The Annals of Mathematical Statistics, Vol. 22, Issue 1
  • DOI: 10.1214/aoms/1177729694

An adaptive hierarchical sparse grid collocation algorithm for the solution of stochastic differential equations
journal, May 2009


A Sparse Grid Stochastic Collocation Method for Partial Differential Equations with Random Input Data
journal, January 2008

  • Nobile, F.; Tempone, R.; Webster, C. G.
  • SIAM Journal on Numerical Analysis, Vol. 46, Issue 5
  • DOI: 10.1137/060663660

Goal-oriented error estimation and adaptivity for the finite element method
journal, March 2001


Interpolation of spatial data – A stochastic or a deterministic problem?
journal, February 2013

  • Scheuerer, M.; Schaback, R.; Schlather, M.
  • European Journal of Applied Mathematics, Vol. 24, Issue 4
  • DOI: 10.1017/S0956792513000016

Karhunen–Loève approximation of random fields by generalized fast multipole methods
journal, September 2006

  • Schwab, Christoph; Todor, Radu Alexandru
  • Journal of Computational Physics, Vol. 217, Issue 1
  • DOI: 10.1016/j.jcp.2006.01.048

Inverse problems: A Bayesian perspective
journal, May 2010


On a Converse to Scheffe's Theorem
journal, September 1986


Variable Kernel Density Estimation
journal, September 1992


A multiscale preconditioner for stochastic mortar mixed finite elements
journal, February 2011

  • Wheeler, Mary F.; Wildey, Tim; Yotov, Ivan
  • Computer Methods in Applied Mechanics and Engineering, Vol. 200, Issue 9-12
  • DOI: 10.1016/j.cma.2010.10.015

The Wiener--Askey Polynomial Chaos for Stochastic Differential Equations
journal, January 2002


An efficient, high-order perturbation approach for flow in random porous media via Karhunen–Loève and polynomial expansions
journal, March 2004


Stochastic collocation and mixed finite elements for flow in porous media
journal, August 2008

  • Ganis, Benjamin; Klie, Hector; Wheeler, Mary F.
  • Computer Methods in Applied Mechanics and Engineering, Vol. 197, Issue 43-44
  • DOI: 10.1016/j.cma.2008.03.025

An adaptive hierarchical sparse grid collocation algorithm for the solution of stochastic differential equations
journal, May 2009


Numerical approach for quantification of epistemic uncertainty
journal, June 2010

  • Jakeman, John; Eldred, Michael; Xiu, Dongbin
  • Journal of Computational Physics, Vol. 229, Issue 12
  • DOI: 10.1016/j.jcp.2010.03.003

Utilizing Adjoint-Based Error Estimates for Surrogate Models to Accurately Predict Probabilities of Events
journal, January 2018


Works referencing / citing this record:

Adaptive multi‐index collocation for uncertainty quantification and sensitivity analysis
journal, November 2019

  • Jakeman, John D.; Eldred, Michael S.; Geraci, Gianluca
  • International Journal for Numerical Methods in Engineering, Vol. 121, Issue 6
  • DOI: 10.1002/nme.6268

Adaptive multi‐index collocation for uncertainty quantification and sensitivity analysis
journal, August 2020

  • Jakeman, John D.; Eldred, Michael S.; Geraci, Gianluca
  • International Journal for Numerical Methods in Engineering, Vol. 121, Issue 19
  • DOI: 10.1002/nme.6450

Adaptive multi-index collocation for uncertainty quantification and sensitivity analysis
report, November 2019


Adaptive sampling-based quadrature rules for efficient Bayesian prediction
text, January 2019