skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Reconstructing probability distributions with Gaussian processes

Journal Article · · Monthly Notices of the Royal Astronomical Society
ORCiD logo [1];  [2]
  1. Brookhaven National Lab. (BNL), Upton, NY (United States). Physics Dept.
  2. Univ. of Arizona, Tuscon, AZ (United States). Dept. of Physics

Modern cosmological analyses constrain physical parameters using Markov Chain Monte Carlo (MCMC) or similar sampling techniques. Oftentimes, these techniques are computationally expensive to run and require up to thousands of CPU hours to complete. Here we present a method for reconstructing the log-probability distributions of completed experiments from an existing chain (or any set of posterior samples). Here, the reconstruction is performed using Gaussian process regression for interpolating the log-probability. This allows for easy resampling, importance sampling, marginalization, testing different samplers, investigating chain convergence, and other operations. As an example use case, we reconstruct the posterior distribution of the most recent Planck 2018 analysis. We then resample the posterior, and generate a new chain with 40 times as many points in only 30 min. Our likelihood reconstruction tool is made publicly available online.

Research Organization:
Brookhaven National Lab. (BNL), Upton, NY (United States)
Sponsoring Organization:
USDOE Office of Science (SC), High Energy Physics (HEP)
Grant/Contract Number:
SC0012704
OSTI ID:
1573465
Report Number(s):
BNL-212314-2019-JAAM; TRN: US2001369
Journal Information:
Monthly Notices of the Royal Astronomical Society, Vol. 489, Issue 3; ISSN 0035-8711
Publisher:
Royal Astronomical SocietyCopyright Statement
Country of Publication:
United States
Language:
English
Citation Metrics:
Cited by: 8 works
Citation information provided by
Web of Science

References (30)

ChainConsumer journal August 2016
Dark Energy Survey Year 1 Results: A Precise H0 Estimate from DES Y1, BAO, and D/H Data journal July 2018
emcee : The MCMC Hammer
  • Foreman-Mackey, Daniel; Hogg, David W.; Lang, Dustin
  • Publications of the Astronomical Society of the Pacific, Vol. 125, Issue 925 https://doi.org/10.1086/670067
journal March 2013
The Mira-Titan Universe. II. Matter Power Spectrum Emulation journal September 2017
Hunting high and low: disentangling primordial and late-time non-Gaussianity with cosmic densities in spheres journal October 2017
The clustering of galaxies in the completed SDSS-III Baryon Oscillation Spectroscopic Survey: cosmological analysis of the DR12 galaxy sample journal March 2017
Fast Direct Methods for Gaussian Processes journal February 2016
Conservative constraints on early cosmology with M ONTE P YTHON journal February 2013
CosmoSIS: Modular cosmological parameter estimation journal September 2015
Gaussian Processes for Machine Learning book January 2005
The Coyote Universe. ii. Cosmological Models and Precision Emulation of the Nonlinear Matter Power Spectrum journal October 2009
Dark Energy Survey Year 1 results: Methodology and projections for joint analysis of galaxy clustering, galaxy lensing, and CMB lensing two-point functions journal January 2019
Matplotlib: A 2D Graphics Environment journal January 2007
Cosmological parameters from CMB and other data: A Monte Carlo approach journal November 2002
Observational Evidence from Supernovae for an Accelerating Universe and a Cosmological Constant journal September 1998
The 6dF Galaxy Survey: baryon acoustic oscillations and the local Hubble constant: 6dFGS: BAOs and the local Hubble constant journal July 2011
A Micromechanical Method for the Analysis of Three-Dimensional Smart Composites journal March 2018
Nuisance hardened data compression for fast likelihood-free inference journal July 2019
Measurements of Ω and Λ from 42 High‐Redshift Supernovae journal June 1999
The NumPy Array: A Structure for Efficient Numerical Computation journal March 2011
The Aemulus Project. II. Emulating the Halo Mass Function journal February 2019
Cosmology from cosmic shear power spectra with Subaru Hyper Suprime-Cam first-year data journal March 2019
Generalized Subset Designs in Analytical Chemistry journal May 2017
CASSPER is a semantic segmentation-based particle picking algorithm for single-particle cryo-electron microscopy journal February 2021
Fast Direct Methods for Gaussian Processes preprint January 2014
CosmoSIS: modular cosmological parameter estimation text January 2014
Dark Energy Survey Year 1 Results: A Precise H0 Measurement from DES Y1, BAO, and D/H Data text January 2017
Cosmology from cosmic shear power spectra with Subaru Hyper Suprime-Cam first-year data text January 2018
Nuisance hardened data compression for fast likelihood-free inference text January 2019
Cosmological parameters from CMB and other data: a Monte-Carlo approach text January 2002

Cited By (1)


Similar Records

A Nonparametric Bayesian Approach For Emission Tomography Reconstruction
Journal Article · Tue Nov 13 00:00:00 EST 2007 · AIP Conference Proceedings · OSTI ID:1573465

nautilus : boosting Bayesian importance nested sampling with deep learning
Journal Article · Wed Aug 16 00:00:00 EDT 2023 · Monthly Notices of the Royal Astronomical Society · OSTI ID:1573465

Parallel tempered trans-dimensional Bayesian inference for the inversion of ultra-deep directional logging-while-drilling resistivity measurements
Journal Article · Sat Jan 18 00:00:00 EST 2020 · Journal of Petroleum Science and Engineering · OSTI ID:1573465