Dimension-independent likelihood-informed MCMC
Abstract
Many Bayesian inference problems require exploring the posterior distribution of highdimensional parameters that represent the discretization of an underlying function. Our work introduces a family of Markov chain Monte Carlo (MCMC) samplers that can adapt to the particular structure of a posterior distribution over functions. There are two distinct lines of research that intersect in the methods we develop here. First, we introduce a general class of operator-weighted proposal distributions that are well defined on function space, such that the performance of the resulting MCMC samplers is independent of the discretization of the function. Second, by exploiting local Hessian information and any associated lowdimensional structure in the change from prior to posterior distributions, we develop an inhomogeneous discretization scheme for the Langevin stochastic differential equation that yields operator-weighted proposals adapted to the non-Gaussian structure of the posterior. The resulting dimension-independent and likelihood-informed (DILI) MCMC samplers may be useful for a large class of high-dimensional problems where the target probability measure has a density with respect to a Gaussian reference measure. Finally, we use two nonlinear inverse problems in order to demonstrate the efficiency of these DILI samplers: an elliptic PDE coefficient inverse problem and path reconstruction in a conditioned diffusion.
- Authors:
-
- Massachusetts Inst. of Technology (MIT), Cambridge, MA (United States)
- Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States)
- Publication Date:
- Research Org.:
- Oak Ridge National Laboratory (ORNL), Oak Ridge, TN (United States)
- Sponsoring Org.:
- USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR)
- OSTI Identifier:
- 1324173
- Alternate Identifier(s):
- OSTI ID: 1359277
- Grant/Contract Number:
- AC05-00OR22725; SC0009297
- Resource Type:
- Accepted Manuscript
- Journal Name:
- Journal of Computational Physics
- Additional Journal Information:
- Journal Volume: 304; Journal Issue: C; Journal ID: ISSN 0021-9991
- Publisher:
- Elsevier
- Country of Publication:
- United States
- Language:
- English
- Subject:
- 97 MATHEMATICS AND COMPUTING; Markov chain Monte Carlo; likelihood-informed subspace; infinite-dimensional inverse problems; langevin SDE; conditioned diffusion
Citation Formats
Cui, Tiangang, Law, Kody J. H., and Marzouk, Youssef M. Dimension-independent likelihood-informed MCMC. United States: N. p., 2015.
Web. doi:10.1016/j.jcp.2015.10.008.
Cui, Tiangang, Law, Kody J. H., & Marzouk, Youssef M. Dimension-independent likelihood-informed MCMC. United States. https://doi.org/10.1016/j.jcp.2015.10.008
Cui, Tiangang, Law, Kody J. H., and Marzouk, Youssef M. Thu .
"Dimension-independent likelihood-informed MCMC". United States. https://doi.org/10.1016/j.jcp.2015.10.008. https://www.osti.gov/servlets/purl/1324173.
@article{osti_1324173,
title = {Dimension-independent likelihood-informed MCMC},
author = {Cui, Tiangang and Law, Kody J. H. and Marzouk, Youssef M.},
abstractNote = {Many Bayesian inference problems require exploring the posterior distribution of highdimensional parameters that represent the discretization of an underlying function. Our work introduces a family of Markov chain Monte Carlo (MCMC) samplers that can adapt to the particular structure of a posterior distribution over functions. There are two distinct lines of research that intersect in the methods we develop here. First, we introduce a general class of operator-weighted proposal distributions that are well defined on function space, such that the performance of the resulting MCMC samplers is independent of the discretization of the function. Second, by exploiting local Hessian information and any associated lowdimensional structure in the change from prior to posterior distributions, we develop an inhomogeneous discretization scheme for the Langevin stochastic differential equation that yields operator-weighted proposals adapted to the non-Gaussian structure of the posterior. The resulting dimension-independent and likelihood-informed (DILI) MCMC samplers may be useful for a large class of high-dimensional problems where the target probability measure has a density with respect to a Gaussian reference measure. Finally, we use two nonlinear inverse problems in order to demonstrate the efficiency of these DILI samplers: an elliptic PDE coefficient inverse problem and path reconstruction in a conditioned diffusion.},
doi = {10.1016/j.jcp.2015.10.008},
journal = {Journal of Computational Physics},
number = C,
volume = 304,
place = {United States},
year = {Thu Oct 08 00:00:00 EDT 2015},
month = {Thu Oct 08 00:00:00 EDT 2015}
}
Web of Science
Works referenced in this record:
Exact and computationally efficient likelihood-based estimation for discretely observed diffusion processes (with discussion)
journal, June 2006
- Beskos, Alexandros; Papaspiliopoulos, Omiros; Roberts, Gareth O.
- Journal of the Royal Statistical Society: Series B (Statistical Methodology), Vol. 68, Issue 3
Optimal scaling for various Metropolis-Hastings algorithms
journal, November 2001
- Roberts, Gareth O.; Rosenthal, Jeffrey S.
- Statistical Science, Vol. 16, Issue 4
Diffusion limits of the random walk Metropolis algorithm in high dimensions
journal, June 2012
- Mattingly, Jonathan C.; Pillai, Natesh S.; Stuart, Andrew M.
- The Annals of Applied Probability, Vol. 22, Issue 3
Optimal scaling and diffusion limits for the Langevin algorithm in high dimensions
journal, December 2012
- Pillai, Natesh S.; Stuart, Andrew M.; Thiéry, Alexandre H.
- The Annals of Applied Probability, Vol. 22, Issue 6
Mcmc Methods for Diffusion Bridges
journal, September 2008
- Beskos, Alexandros; Roberts, Gareth; Stuart, Andrew
- Stochastics and Dynamics, Vol. 08, Issue 03
MCMC Methods for Functions: Modifying Old Algorithms to Make Them Faster
journal, August 2013
- Cotter, S. L.; Roberts, G. O.; Stuart, A. M.
- Statistical Science, Vol. 28, Issue 3
A sequential particle filter method for static models
journal, August 2002
- Chopin, N.
- Biometrika, Vol. 89, Issue 3
Sequential Monte Carlo samplers
journal, June 2006
- Del Moral, Pierre; Doucet, Arnaud; Jasra, Ajay
- Journal of the Royal Statistical Society: Series B (Statistical Methodology), Vol. 68, Issue 3
Particle Markov chain Monte Carlo methods: Particle Markov Chain Monte Carlo Methods
journal, June 2010
- Andrieu, Christophe; Doucet, Arnaud; Holenstein, Roman
- Journal of the Royal Statistical Society: Series B (Statistical Methodology), Vol. 72, Issue 3
Multilevel Monte Carlo Path Simulation
journal, June 2008
- Giles, Michael B.
- Operations Research, Vol. 56, Issue 3
Complexity analysis of accelerated MCMC methods for Bayesian inversion
journal, July 2013
- Hoang, Viet Ha; Schwab, Christoph; Stuart, Andrew M.
- Inverse Problems, Vol. 29, Issue 8
A Stochastic Newton MCMC Method for Large-Scale Statistical Inverse Problems with Application to Seismic Inversion
journal, January 2012
- Martin, James; Wilcox, Lucas C.; Burstedde, Carsten
- SIAM Journal on Scientific Computing, Vol. 34, Issue 3
Riemann manifold Langevin and Hamiltonian Monte Carlo methods: Riemann Manifold Langevin and Hamiltonian Monte Carlo Methods
journal, March 2011
- Girolami, Mark; Calderhead, Ben
- Journal of the Royal Statistical Society: Series B (Statistical Methodology), Vol. 73, Issue 2
Proposals which speed up function-space MCMC
journal, May 2014
- Law, K. J. H.
- Journal of Computational and Applied Mathematics, Vol. 262
Likelihood-informed dimension reduction for nonlinear inverse problems
journal, October 2014
- Cui, T.; Martin, J.; Marzouk, Y. M.
- Inverse Problems, Vol. 30, Issue 11
MAP estimators and their consistency in Bayesian nonparametric inverse problems
journal, September 2013
- Dashti, M.; Law, K. J. H.; Stuart, A. M.
- Inverse Problems, Vol. 29, Issue 9
Equation of State Calculations by Fast Computing Machines
journal, June 1953
- Metropolis, Nicholas; Rosenbluth, Arianna W.; Rosenbluth, Marshall N.
- The Journal of Chemical Physics, Vol. 21, Issue 6
Monte Carlo sampling methods using Markov chains and their applications
journal, April 1970
- Hastings, W. K.
- Biometrika, Vol. 57, Issue 1
A note on Metropolis-Hastings kernels for general state spaces
journal, February 1998
- Tierney, Luke
- The Annals of Applied Probability, Vol. 8, Issue 1
Optimal scaling of discrete approximations to Langevin diffusions
journal, February 1998
- Roberts, Gareth O.; Rosenthal, Jeffrey S.
- Journal of the Royal Statistical Society: Series B (Statistical Methodology), Vol. 60, Issue 1
Spectral gaps for a Metropolis–Hastings algorithm in infinite dimensions
journal, December 2014
- Hairer, Martin; Stuart, Andrew M.; Vollmer, Sebastian J.
- The Annals of Applied Probability, Vol. 24, Issue 6
Fast Algorithms for Bayesian Uncertainty Quantification in Large-Scale Linear Inverse Problems Based on Low-Rank Partial Hessian Approximations
journal, January 2011
- Flath, H. P.; Wilcox, L. C.; Akçelik, V.
- SIAM Journal on Scientific Computing, Vol. 33, Issue 1
A Computational Framework for Infinite-Dimensional Bayesian Inverse Problems Part I: The Linearized Case, with Application to Global Seismic Inversion
journal, January 2013
- Bui-Thanh, Tan; Ghattas, Omar; Martin, James
- SIAM Journal on Scientific Computing, Vol. 35, Issue 6
An Adaptive Metropolis Algorithm
journal, April 2001
- Haario, Heikki; Saksman, Eero; Tamminen, Johanna
- Bernoulli, Vol. 7, Issue 2
An Adaptive Version for the Metropolis Adjusted Langevin Algorithm with a Truncated Drift
journal, June 2006
- Atchadé, Yves F.
- Methodology and Computing in Applied Probability, Vol. 8, Issue 2
Finding Structure with Randomness: Probabilistic Algorithms for Constructing Approximate Matrix Decompositions
journal, January 2011
- Halko, N.; Martinsson, P. G.; Tropp, J. A.
- SIAM Review, Vol. 53, Issue 2
Randomized algorithms for the low-rank approximation of matrices
journal, December 2007
- Liberty, E.; Woolfe, F.; Martinsson, P. -G.
- Proceedings of the National Academy of Sciences, Vol. 104, Issue 51
Weighted Subspace Distance and Its Applications to Object Recognition and Retrieval With Image Sets
journal, March 2009
- Li, Fei; Dai, Qionghai; Xu, Wenli
- IEEE Signal Processing Letters, Vol. 16, Issue 3
On the ergodicity properties of some adaptive MCMC algorithms
journal, August 2006
- Andrieu, Christophe; Moulines, Éric
- The Annals of Applied Probability, Vol. 16, Issue 3
Coupling and Ergodicity of Adaptive Markov Chain Monte Carlo Algorithms
journal, June 2007
- Roberts, Gareth O.; Rosenthal, Jeffrey S.
- Journal of Applied Probability, Vol. 44, Issue 2
On the ergodicity of the adaptive Metropolis algorithm on unbounded domains
journal, December 2010
- Saksman, Eero; Vihola, Matti
- The Annals of Applied Probability, Vol. 20, Issue 6
Langevin Diffusions and Metropolis-Hastings Algorithms
journal, December 2002
- Roberts, G. O.
- Methodology and Computing in Applied Probability, Vol. 4, Issue 4, p. 337-357
A Computational Framework for Infinite-Dimensional Bayesian Inverse Problems, Part II: Stochastic Newton MCMC with Application to Ice Sheet Flow Inverse Problems
journal, January 2014
- Petra, Noemi; Martin, James; Stadler, Georg
- SIAM Journal on Scientific Computing, Vol. 36, Issue 4
Active Subspace Methods in Theory and Practice: Applications to Kriging Surfaces
journal, January 2014
- Constantine, Paul G.; Dow, Eric; Wang, Qiqi
- SIAM Journal on Scientific Computing, Vol. 36, Issue 4
A stable manifold MCMC method for high dimensions
journal, July 2014
- Beskos, Alexandros
- Statistics & Probability Letters, Vol. 90
Exact and computationally efficient likelihood-based estimation for discretely observed diffusion processes (with discussion)
journal, June 2006
- Beskos, Alexandros; Papaspiliopoulos, Omiros; Roberts, Gareth O.
- Journal of the Royal Statistical Society: Series B (Statistical Methodology), Vol. 68, Issue 3
Optimal scaling for various Metropolis-Hastings algorithms
journal, November 2001
- Roberts, Gareth O.; Rosenthal, Jeffrey S.
- Statistical Science, Vol. 16, Issue 4
Diffusion limits of the random walk Metropolis algorithm in high dimensions
text, January 2010
- Mattingly, Jonathan C.; Pillai, Natesh S.; Stuart, Andrew M.
- arXiv
Optimal scaling and diffusion limits for the Langevin algorithm in high dimensions
text, January 2011
- Pillai, Natesh S.; Stuart, Andrew M.; Thiéry, Alexandre H.
- arXiv
A Hierarchical Multilevel Markov Chain Monte Carlo Algorithm with Applications to Uncertainty Quantification in Subsurface Flow
preprint, January 2013
- Dodwell, T. J.; Ketelsen, C.; Scheichl, R.
- arXiv
Works referencing / citing this record:
Sampling via Measure Transport: An Introduction
book, January 2016
- Marzouk, Youssef; Moselhy, Tarek; Parno, Matthew
- Handbook of Uncertainty Quantification
Randomized Truncated SVD Levenberg‐Marquardt Approach to Geothermal Natural State and History Matching
journal, March 2018
- Bjarkason, Elvar K.; Maclaren, Oliver J.; O'Sullivan, John P.
- Water Resources Research, Vol. 54, Issue 3
Inverse problems: From regularization to Bayesian inference
journal, January 2018
- Calvetti, D.; Somersalo, E.
- WIREs Computational Statistics, Vol. 10, Issue 3
Efficient parameter estimation for a methane hydrate model with active subspaces
journal, August 2018
- Teixeira Parente, Mario; Mattis, Steven; Gupta, Shubhangi
- Computational Geosciences, Vol. 23, Issue 2
Wavelet-Based Priors Accelerate Maximum-a-Posteriori Optimization in Bayesian Inverse Problems
journal, July 2019
- Wacker, Philipp; Knabner, Peter
- Methodology and Computing in Applied Probability, Vol. 22, Issue 3
Spatial Localization for Nonlinear Dynamical Stochastic Models for Excitable Media
journal, November 2019
- Chen, Nan; Majda, Andrew J.; Tong, Xin T.
- Chinese Annals of Mathematics, Series B, Vol. 40, Issue 6
Scaling limits in computational Bayesian inversion
journal, October 2016
- Schillings, Claudia; Schwab, Christoph
- ESAIM: Mathematical Modelling and Numerical Analysis, Vol. 50, Issue 6
Bayesian Calibration and Sensitivity Analysis for a Karst Aquifer Model Using Active Subspaces
journal, August 2019
- Teixeira Parente, Mario; Bittner, Daniel; Mattis, Steven A.
- Water Resources Research, Vol. 55, Issue 8
A posteriori stochastic correction of reduced models in delayed-acceptance MCMC, with application to multiphase subsurface inverse problems: Stochastic correction of reduced models in delayed-acceptance MCMC
journal, March 2019
- Cui, Tiangang; Fox, Colin; O'Sullivan, Michael J.
- International Journal for Numerical Methods in Engineering, Vol. 118, Issue 10
Sampling via Measure Transport: An Introduction
book, June 2017
- Marzouk, Youssef; Moselhy, Tarek; Parno, Matthew
- Handbook of Uncertainty Quantification
Scaling Limits in Computational Bayesian Inversion
text, January 2014
- Schillings, Claudia; Schwab, Christoph
- ETH Zurich
Bayesian Calibration and Sensitivity Analysis for a Karst Aquifer Model Using Active Subspaces
text, January 2019
- Teixeira Parente, Mario; Bittner, Daniel; Mattis, Steven A.
- FID GEO
Randomized Truncated SVD Levenberg-Marquardt Approach to Geothermal Natural State and History Matching
text, January 2017
- Bjarkason, Elvar K.; Maclaren, Oliver J.; O'Sullivan, John P.
- arXiv
Efficient parameter estimation for a methane hydrate model with active subspaces
text, January 2018
- Parente, Mario Teixeira; Mattis, Steven; Gupta, Shubhangi
- arXiv
Spatial localization for nonlinear dynamical stochastic models for excitable media
preprint, January 2019
- Chen, Nan; Majda, Andrew J.; Tong, Xin T.
- arXiv