Accelerated Dimension-Independent Adaptive Metropolis
- King Abdullah University of Science and Technology (KAUST), Thuwal (Saudi Arabia)
- Columbia Univ., New York, NY (United States)
- Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States)
- King Abdullah University of Science and Technology (KAUST), Thuwal, Kingdom of Saudi Arabia
This work describes improvements from algorithmic and architectural means to black-box Bayesian inference over high-dimensional parameter spaces. The well-known adaptive Metropolis (AM) algorithm [33] is extended herein to scale asymptotically uniformly with respect to the underlying parameter dimension for Gaussian targets, by respecting the variance of the target. The resulting algorithm, referred to as the dimension-independent adaptive Metropolis (DIAM) algorithm, also shows improved performance with respect to adaptive Metropolis on non-Gaussian targets. This algorithm is further improved, and the possibility of probing high-dimensional (with dimension d 1000) targets is enabled, via GPU-accelerated numerical libraries and periodically synchronized concurrent chains (justi ed a posteriori). Asymptotically in dimension, this GPU implementation exhibits a factor of four improvement versus a competitive CPU-based Intel MKL parallel version alone. Strong scaling to concurrent chains is exhibited, through a combination of longer time per sample batch (weak scaling) and yet fewer necessary samples to convergence. The algorithm performance is illustrated on several Gaussian and non-Gaussian target examples, in which the dimension may be in excess of one thousand.
- Research Organization:
- Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States)
- Sponsoring Organization:
- USDOE
- Grant/Contract Number:
- AC05-00OR22725
- OSTI ID:
- 1346642
- Journal Information:
- SIAM Journal on Scientific Computing, Vol. 38, Issue 5; ISSN 1064-8275
- Publisher:
- SIAMCopyright Statement
- Country of Publication:
- United States
- Language:
- English
Web of Science
Similar Records
Tensor Contraction and Operation Minimization forExtreme Scale Computational Chemistry
Dimension-independent likelihood-informed MCMC