skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Advanced Multilevel Monte Carlo Methods

Journal Article · · International Statistical Review
DOI:https://doi.org/10.1111/insr.12365· OSTI ID:1862171
ORCiD logo [1];  [2];  [1]
  1. King Abdullah University of Science and Technology (KAUST), Thuwal (Saudi Arabia)
  2. Univ. of Manchester (United Kingdom)

This article reviews the application of some advanced Monte Carlo techniques in the context of multilevel Monte Carlo (MLMC). MLMC is a strategy employed to compute expectations, which can be biassed in some sense, for instance, by using the discretization of an associated probability law. The MLMC approach works with a hierarchy of biassed approximations, which become progressively more accurate and more expensive. Additionally, using a telescoping representation of the most accurate approximation, the method is able to reduce the computational cost for a given level of error versus i.i.d. sampling from this latter approximation. All of these ideas originated for cases where exact sampling from couples in the hierarchy is possible. This article considers the case where such exact sampling is not currently possible. We consider some Markov chain Monte Carlo and sequential Monte Carlo methods, which have been introduced in the literature, and we describe different strategies that facilitate the application of MLMC within these methods.

Research Organization:
Oak Ridge National Laboratory (ORNL), Oak Ridge, TN (United States)
Sponsoring Organization:
USDOE Laboratory Directed Research and Development (LDRD) Program
Grant/Contract Number:
AC05-00OR22725; 32102582
OSTI ID:
1862171
Journal Information:
International Statistical Review, Vol. 88, Issue 3; ISSN 0306-7734
Publisher:
WileyCopyright Statement
Country of Publication:
United States
Language:
English

References (84)

Deterministic Mean-Field Ensemble Kalman Filtering journal January 2016
Hybrid Monte Carlo journal September 1987
A Seamless Multilevel Ensemble Transform Particle Filter journal January 2017
Multilevel Monte Carlo methods and applications to elliptic PDEs with random coefficients journal January 2011
Multilevel Monte Carlo in approximate Bayesian computation journal January 2019
On population-based simulation for static inference journal July 2007
An adaptive sequential Monte Carlo method for approximate Bayesian computation journal August 2011
Multilevel Sequential Monte Carlo with Dimension-Independent Likelihood-Informed Proposals journal January 2018
Complexity analysis of accelerated MCMC methods for Bayesian inversion journal July 2013
The Ensemble Kalman Filter: theoretical formulation and practical implementation journal November 2003
On the stability of sequential Monte Carlo methods in high dimensions journal August 2014
Conditioning on One-Step Survival for Barrier Option Simulations journal December 2001
On the convergence of the Laplace approximation and noise-level-robustness of Laplace-based Monte Carlo methods for Bayesian inverse problems journal July 2020
Multilevel Ensemble Transform Particle Filtering journal January 2016
Multilevel Sequential2 Monte Carlo for Bayesian inverse problems journal September 2018
Markov Chain Monte Carlo and Irreversibility journal June 2016
Monte Carlo Statistical Methods book January 2004
MCMC Methods for Functions: Modifying Old Algorithms to Make Them Faster journal August 2013
A Hierarchical Multilevel Markov Chain Monte Carlo Algorithm with Applications to Uncertainty Quantification in Subsurface Flow journal January 2015
The correlated pseudomarginal method
  • Deligiannidis, George; Doucet, Arnaud; Pitt, Michael K.
  • Journal of the Royal Statistical Society: Series B (Statistical Methodology), Vol. 80, Issue 5 https://doi.org/10.1111/rssb.12280
journal July 2018
Annealed importance sampling journal April 2001
Nonequilibrium Equality for Free Energy Differences journal April 1997
Convergence analysis of multilevel Monte Carlo variance estimators and application for random obstacle problems journal December 2014
Particle filters for partially observed diffusions journal September 2008
A New Approach to Linear Filtering and Prediction Problems journal March 1960
Efficient implementation of Markov chain Monte Carlo when using an unbiased likelihood estimator journal March 2015
Approximate Bayesian computational methods journal October 2011
Weak convergence and optimal scaling of random walk Metropolis algorithms journal February 1997
Obstacles to High-Dimensional Particle Filtering journal December 2008
A sequential particle filter method for static models journal August 2002
On coupling particle filter trajectories journal March 2017
Unbiased Estimation with Square Root Convergence for SDE Models journal October 2015
The pseudo-marginal approach for efficient Monte Carlo computations journal April 2009
Can local particle filters beat the curse of dimensionality? journal October 2015
The Bouncy Particle Sampler: A Nonreversible Rejection-Free Markov Chain Monte Carlo Method journal April 2018
Inference for Lévy-Driven Stochastic Volatility Models via Adaptive Sequential Monte Carlo: Lévy-driven stochastic volatility journal December 2010
Sequential Monte Carlo samplers journal June 2006
A stable particle filter for a class of high-dimensional state-space models journal March 2017
On Particle Methods for Parameter Estimation in State-Space Models journal August 2015
Sequential Monte Carlo on large binary sampling spaces journal November 2011
Feynman-Kac Formulae book January 2004
Particle Markov chain Monte Carlo methods: Particle Markov Chain Monte Carlo Methods journal June 2010
On the convergence of adaptive sequential Monte Carlo methods journal April 2016
Sequential data assimilation with a nonlinear quasi-geostrophic model using Monte Carlo methods to forecast error statistics journal January 1994
Multilevel sequential Monte Carlo: Mean square error bounds under verifiable conditions journal December 2016
Quasi-Monte Carlo and Multilevel Monte Carlo Methods for Computing Posterior Expectations in Elliptic Inverse Problems journal January 2017
Multilevel ensemble Kalman filtering journal January 2016
Multilevel Monte Carlo Methods book January 2001
Transitional Markov Chain Monte Carlo Method for Bayesian Model Updating, Model Class Selection, and Model Averaging journal July 2007
Scaling limits in computational Bayesian inversion journal October 2016
The sample size required in importance sampling journal April 2018
Multilevel sequential Monte Carlo samplers journal May 2017
Multilevel particle filters: normalizing constant estimation journal November 2016
Bayesian Static Parameter Estimation for Partially Observed Diffusions via Multilevel Monte Carlo journal January 2018
Sequential Monte Carlo Methods for High-Dimensional Inverse Problems: A Case Study for the Navier--Stokes Equations journal January 2014
Unbiased multi-index Monte Carlo journal December 2017
On the ergodicity properties of some adaptive MCMC algorithms journal August 2006
Multilevel Monte Carlo methods journal April 2015
Particle Filtering for Stochastic Navier--Stokes Signal Observed with Linear Additive Noise journal January 2018
On particle Gibbs sampling journal August 2015
Multilevel Monte Carlo Path Simulation journal June 2008
Multi-index Monte Carlo: when sparsity meets sampling journal June 2015
Multilevel particle filters for Lévy-driven stochastic differential equations journal October 2018
A function space HMC algorithm with second order Langevin diffusion limit journal February 2016
Limit theorems for weighted samples with applications to sequential Monte Carlo methods journal October 2008
Multilevel Monte Carlo for Smoothing via Transport Methods journal January 2018
An Adaptive Metropolis Algorithm journal April 2001
On the convergence of the ensemble Kalman filter journal December 2011
Exponential Convergence of Langevin Distributions and Their Discrete Approximations journal December 1996
Central limit theorem for sequential Monte Carlo methods and its application to Bayesian inference journal December 2004
General state space Markov chains and MCMC algorithms journal January 2004
Mcmc Methods for Diffusion Bridges journal September 2008
Sequential Monte Carlo Samplers: Error Bounds and Insensitivity to Initial Conditions journal September 2012
Multilevel Particle Filters journal January 2017
Data Assimilation: A Mathematical Introduction book January 2015
Error Bounds and Normalising Constants for Sequential Monte Carlo Samplers in High Dimensions journal March 2014
SMC 2 : an efficient algorithm for sequential analysis of state space models: Sequential Analysis of State Space Models journal October 2012
Uniform Ergodicity of the Particle Gibbs Sampler journal February 2015
Limit theorems for weighted samples with applications to sequential Monte Carlo methods journal January 2007
Multilevel Monte Carlo for Scalable Bayesian Computations preprint January 2016
Bayesian Static Parameter Estimation for Partially Observed Diffusions via Multilevel Monte Carlo preprint January 2017
Unbiased Multi-index Monte Carlo preprint January 2017
A Multi-Index Markov Chain Monte Carlo Method preprint January 2017
General state space Markov chains and MCMC algorithms text January 2004

Cited By (3)

Multi-Index Sequential Monte Carlo Methods for Partially Observed Stochastic Partial Differential Equations journal January 2021
Markov chain simulation for multilevel Monte Carlo journal January 2021
Unbiased Estimation of the Solution to Zakai's Equation preprint January 2020

Similar Records

Bayesian Static Parameter Estimation for Partially Observed Diffusions via Multilevel Monte Carlo
Journal Article · Tue Mar 27 00:00:00 EDT 2018 · SIAM Journal on Scientific Computing · OSTI ID:1862171

Multilevel sequential Monte Carlo samplers
Journal Article · Wed Aug 24 00:00:00 EDT 2016 · Stochastic Processes and Their Applications · OSTI ID:1862171

Forward and inverse uncertainty quantification using multilevel Monte Carlo algorithms for an elliptic non-local equation
Journal Article · Fri Jan 01 00:00:00 EST 2016 · International Journal for Uncertainty Quantification · OSTI ID:1862171