DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Multiscale Flow for robust and optimal cosmological analysis

Journal Article · · Proceedings of the National Academy of Sciences of the United States of America
ORCiD logo [1]; ORCiD logo [2]
  1. Berkeley Center for Cosmological Physics and Department of Physics, University of California, Berkeley, CA 94720, Physics Division, Lawrence Berkeley National Lab, Berkeley, CA 94720
  2. Berkeley Center for Cosmological Physics and Department of Physics, University of California, Berkeley, CA 94720, Physics Division, Lawrence Berkeley National Lab, Berkeley, CA 94720, Department of Astronomy, University of California, Berkeley, CA 94720

We propose Multiscale Flow, a generative Normalizing Flow that creates samples and models the field-level likelihood of two-dimensional cosmological data such as weak lensing. Multiscale Flow uses hierarchical decomposition of cosmological fields via a wavelet basis and then models different wavelet components separately as Normalizing Flows. The log-likelihood of the original cosmological field can be recovered by summing over the log-likelihood of each wavelet term. This decomposition allows us to separate the information from different scales and identify distribution shifts in the data such as unknown scale-dependent systematics. The resulting likelihood analysis can not only identify these types of systematics, but can also be made optimal, in the sense that the Multiscale Flow can learn the full likelihood at the field without any dimensionality reduction. We apply Multiscale Flow to weak lensing mock datasets for cosmological inference and show that it significantly outperforms traditional summary statistics such as power spectrum and peak counts, as well as machine learning–based summary statistics such as scattering transform and convolutional neural networks. We further show that Multiscale Flow is able to identify distribution shifts not in the training data such as baryonic effects. Finally, we demonstrate that Multiscale Flow can be used to generate realistic samples of weak lensing data.

Sponsoring Organization:
USDOE
Grant/Contract Number:
AC02-05CH11231
OSTI ID:
2310422
Alternate ID(s):
OSTI ID: 2469634
Journal Information:
Proceedings of the National Academy of Sciences of the United States of America, Journal Name: Proceedings of the National Academy of Sciences of the United States of America Journal Issue: 9 Vol. 121; ISSN 0027-8424
Publisher:
Proceedings of the National Academy of SciencesCopyright Statement
Country of Publication:
United States
Language:
English

References (59)

The frontier of simulation-based inference journal May 2020
Simulating galaxy formation with the IllustrisTNG model journal October 2017
The Large-Scale Structure of the Universe book December 1981
Mocking the weak lensing universe: The LensTools Python computing package journal October 2016
Weak lensing from space: first cosmological constraints from three-point shear statistics★: COSMOS: three-point shear statistics journal September 2010
nIFTY galaxy cluster simulations – III. The similarity and diversity of galaxies and subhaloes journal February 2016
Statistical analysis of catalogs of extragalactic objects. V - Three-point correlation function for the galaxy distribution in the Zwicky catalog journal February 1975
Statistics of Dark Matter Halos from Gravitational Lensing journal February 2000
The hierarchy of correlation functions and its relation to other measures of galaxy clustering journal February 1979
Cosmological studies from HSC-SSP tomographic weak-lensing peak abundances journal October 2022
Group Invariant Scattering journal July 2012
Quantification of High-dimensional Non-Gaussianities and Its Implication to Fisher Analysis in Cosmology journal April 2023
A new approach to observational cosmology using the scattering transform journal October 2020
Bayesian physical reconstruction of initial conditions from large-scale structure surveys journal April 2013
Lossless, scalable implicit likelihood inference for cosmological fields journal November 2021
A marked correlation function for constraining modified gravity models journal November 2016
The Hyper Suprime-Cam SSP Survey: Overview and survey design journal September 2017
KiDS-450: cosmological constraints from weak-lensing peak statistics – II: Inference from shear peaks using N-body simulations journal October 2017
Gravitational Lenses book January 1992
New interpretable statistics for large-scale structure analysis and generation journal November 2020
CFHTLenS: cosmological constraints from a combination of cosmic shear two-point and three-point correlations journal May 2014
Hybrid Monte Carlo journal September 1987
Zur Theorie der orthogonalen Funktionensysteme: Erste Mitteilung journal September 1910
Full wCDM analysis of KiDS-1000 weak lensing maps using deep learning journal April 2022
Probing cosmology with weak lensing peak counts journal February 2010
Modelling baryonic physics in future weak lensing surveys journal June 2019
Cosmic shear cosmology beyond two-point statistics: a combined peak count and correlation function analysis of DES-Y1 journal June 2021
Weak lensing scattering transform: dark energy and neutrino mass sensitivity journal July 2021
Bias-variance tradeoff in hybrid generative-discriminative models conference December 2007
LSST: From Science Drivers to Reference Design and Anticipated Data Products journal March 2019
Cosmological constraints with deep learning from KiDS-450 weak lensing maps journal September 2019
The impact of baryons on cosmological inference from weak lensing statistics journal July 2021
Cosmological constraints from HSC survey first-year data using deep learning journal March 2023
HIFlow: Generating Diverse Hi Maps and Inferring Cosmology while Marginalizing over Astrophysics Using Normalizing Flows journal September 2022
Cosmology and the bispectrum journal July 2006
Realistic galaxy image simulation via score-based generative models journal January 2022
The cosmological simulation code gadget-2 journal December 2005
Weak lensing cosmology with convolutional neural networks on noisy data journal September 2019
k -cut cosmic shear: Tunable power spectrum sensitivity to test gravity journal October 2018
Translation and rotation equivariant normalizing flow (TRENF) for optimal cosmological analysis journal July 2022
Orthonormal bases of compactly supported wavelets journal October 1988
Modelling the large-scale mass density field of the universe as a function of cosmology and baryonic physics journal May 2020
Training restricted Boltzmann machines using approximations to the likelihood gradient conference January 2008
Rejuvenating the Matter Power Spectrum: Restoring Information with a Logarithmic Density Mapping journal May 2009
Non-Gaussian information from weak lensing data via deep learning journal May 2018
A theory for multiresolution signal decomposition: the wavelet representation journal July 1989
Simultaneously constraining cosmology and baryonic physics via deep learning from weak lensing journal January 2022
Elucid—Exploring the Local Universe with the Reconstructed Initial Density Field. i. Hamiltonian Markov Chain Monte Carlo Method with Particle mesh Dynamics journal September 2014
Cosmological constraints from noisy convergence maps through deep learning journal December 2018
The initial conditions of the Universe from constrained simulations journal November 2012
Learning Cosmology and Clustering with Cosmic Graphs journal October 2022
simba: Cosmological simulations with black hole growth and feedback journal April 2019
Dark energy survey internal consistency tests of the joint cosmological probes analysis with posterior predictive distributions journal February 2021
Automatic physical inference with information maximizing neural networks journal April 2018
Dark energy survey year 3 results: Cosmology with peaks using an emulator approach journal January 2022
Towards optimal extraction of cosmological information from nonlinear data journal December 2017
Towards an optimal estimation of cosmological parameters with the wavelet scattering transform journal May 2022
Lifting weak lensing degeneracies with a field-based likelihood journal November 2021
Can diffusion model conditionally generate astrophysical images? journal September 2023