Title: Accelerating astronomical and cosmological inference with preconditioned Monte Carlo

Journal Article · · Monthly Notices of the Royal Astronomical Society

ABSTRACT We introduce preconditioned Monte Carlo (PMC), a novel Monte Carlo method for Bayesian inference that facilitates efficient sampling of probability distributions with non-trivial geometry. PMC utilizes a Normalizing Flow (NF) in order to decorrelate the parameters of the distribution and then proceeds by sampling from the preconditioned target distribution using an adaptive Sequential Monte Carlo (SMC) scheme. The results produced by PMC include samples from the posterior distribution and an estimate of the model evidence that can be used for parameter inference and model comparison, respectively. The aforementioned framework has been thoroughly tested in a variety of challenging target distributions achieving state-of-the-art sampling performance. In the cases of primordial feature analysis and gravitational wave inference, PMC is approximately 50 and 25 times faster, respectively, than nested sampling (NS). We found that in higher dimensional applications, the acceleration is even greater. Finally, PMC is directly parallelisable, manifesting linear scaling up to thousands of CPUs.

Research Organization:
Lawrence Berkeley National Laboratory (LBNL), Berkeley, CA (United States)
Sponsoring Organization:
USDOE; USDOE Office of Science (SC), High Energy Physics (HEP)
Grant/Contract Number:
AC02-05CH11231
OSTI ID:
1885874
Journal Information:
Monthly Notices of the Royal Astronomical Society, Journal Name: Monthly Notices of the Royal Astronomical Society Journal Issue: 2 Vol. 516; ISSN 0035-8711
Publisher:
Oxford University PressCopyright Statement
Country of Publication:
United Kingdom
Language:
English

References (25)

Parallel distributed computing using Python journal September 2011
Probability Theory book January 2003
Bayesian Logical Data Analysis for the Physical Sciences book January 2012
SciPy 1.0: fundamental algorithms for scientific computing in Python journal February 2020
Equation of State Calculations by Fast Computing Machines journal June 1953
Nested Sampling
  • Skilling, John
  • BAYESIAN INFERENCE AND MAXIMUM ENTROPY METHODS IN SCIENCE AND ENGINEERING: 24th International Workshop on Bayesian Inference and Maximum Entropy Methods in Science and Engineering, AIP Conference Proceedings https://doi.org/10.1063/1.1835238
conference January 2004
emcee : The MCMC Hammer
  • Foreman-Mackey, Daniel; Hogg, David W.; Lang, Dustin
  • Publications of the Astronomical Society of the Pacific, Vol. 125, Issue 925 https://doi.org/10.1086/670067
journal March 2013
Sdss-Iii: Massive Spectroscopic Surveys of the Distant Universe, the Milky way, and Extra-Solar Planetary Systems journal August 2011
The Baryon Oscillation Spectroscopic Survey of Sdss-Iii journal December 2012
Monte Carlo sampling methods using Markov chains and their applications journal April 1970
Accelerated Bayesian inference using deep learning journal May 2020
dynesty: a dynamic nested sampling package for estimating Bayesian posteriors and evidences journal February 2020
zeus: a python implementation of ensemble slice sampling for efficient Bayesian parameter inference journal October 2021
polychord: next-generation nested sampling journal September 2015
Flow-based generative models for Markov chain Monte Carlo in lattice field theory journal August 2019
Nested sampling with normalizing flows for gravitational-wave inference journal May 2021
Primordial features from linear to nonlinear scales journal December 2019
The NumPy Array: A Structure for Efficient Numerical Computation journal March 2011
MultiNest: an efficient and robust Bayesian inference tool for cosmology and particle physics journal October 2009
Sequential Monte Carlo samplers journal June 2006
Markov Chain Monte Carlo Methods for Bayesian Data Analysis in Astronomy journal August 2017
Weak convergence and optimal scaling of random walk Metropolis algorithms journal February 1997
tqdm: A Fast, Extensible Progress Meter for Python and CLI journal May 2019
seaborn: statistical data visualization journal April 2021
Bilby: A User-friendly Bayesian Inference Library for Gravitational-wave Astronomy journal April 2019

Similar Records

Persistent Sampling: Enhancing the Efficiency of Sequential Monte Carlo
Journal Article · 2025 · Statistics and computing · OSTI ID:2583666

Approximate inference for constructing astronomical catalogs from images
Journal Article · 2019 · The Annals of Applied Statistics · OSTI ID:1650073

Validating sequential Monte Carlo for gravitational-wave inference
Journal Article · 2025 · Monthly Notices of the Royal Astronomical Society · OSTI ID:3015179