Towards optimal extraction of cosmological information from nonlinear data
Abstract
One of the main unsolved problems of cosmology is how to maximize the extraction of information from nonlinear data. If the data are nonlinear the usual approach is to employ a sequence of statistics (N-point statistics, counting statistics of clusters, density peaks or voids etc.), along with the corresponding covariance matrices. However, this approach is computationally prohibitive and has not been shown to be exhaustive in terms of information content. Here we instead develop a hierarchical Bayesian approach, expanding the likelihood around the maximum posterior of linear modes, which we solve for using optimization methods. By integrating out the modes using perturbative expansion of the likelihood we construct an initial power spectrum estimator, which for a fixed forward model contains all the cosmological information if the initial modes are gaussian distributed. We develop a method to construct the window and covariance matrix such that the estimator is explicitly unbiased and nearly optimal. We then generalize the method to include the forward model parameters, including cosmological and nuisance parameters, and primordial non-gaussianity. We apply the method in the simplified context of nonlinear structure formation, using either simplified 2-LPT dynamics or N-body simulations as the nonlinear mapping between linear and nonlinear density,more »
- Authors:
-
- Univ. of California, Berkeley, CA (United States). Berkeley Center for Cosmological Physics and Dept. of Physics; Univ. of California, Berkeley, CA (United States). Dept. of Astronomy; Lawrence Berkeley National Lab. (LBNL), Berkeley, CA (United States). Physics Dept.
- Univ. of California, Berkeley, CA (United States). Berkeley Center for Cosmological Physics and Dept. of Physics
- Publication Date:
- Research Org.:
- Lawrence Berkeley National Laboratory (LBNL), Berkeley, CA (United States). National Energy Research Scientific Computing Center (NERSC)
- Sponsoring Org.:
- USDOE Office of Science (SC)
- OSTI Identifier:
- 1523502
- Grant/Contract Number:
- AC02-05CH11231
- Resource Type:
- Accepted Manuscript
- Journal Name:
- Journal of Cosmology and Astroparticle Physics
- Additional Journal Information:
- Journal Volume: 2017; Journal Issue: 12; Journal ID: ISSN 1475-7516
- Publisher:
- Institute of Physics (IOP)
- Country of Publication:
- United States
- Language:
- English
- Subject:
- 79 ASTRONOMY AND ASTROPHYSICS
Citation Formats
Seljak, Uroš, Aslanyan, Grigor, Feng, Yu, and Modi, Chirag. Towards optimal extraction of cosmological information from nonlinear data. United States: N. p., 2017.
Web. doi:10.1088/1475-7516/2017/12/009.
Seljak, Uroš, Aslanyan, Grigor, Feng, Yu, & Modi, Chirag. Towards optimal extraction of cosmological information from nonlinear data. United States. https://doi.org/10.1088/1475-7516/2017/12/009
Seljak, Uroš, Aslanyan, Grigor, Feng, Yu, and Modi, Chirag. Tue .
"Towards optimal extraction of cosmological information from nonlinear data". United States. https://doi.org/10.1088/1475-7516/2017/12/009. https://www.osti.gov/servlets/purl/1523502.
@article{osti_1523502,
title = {Towards optimal extraction of cosmological information from nonlinear data},
author = {Seljak, Uroš and Aslanyan, Grigor and Feng, Yu and Modi, Chirag},
abstractNote = {One of the main unsolved problems of cosmology is how to maximize the extraction of information from nonlinear data. If the data are nonlinear the usual approach is to employ a sequence of statistics (N-point statistics, counting statistics of clusters, density peaks or voids etc.), along with the corresponding covariance matrices. However, this approach is computationally prohibitive and has not been shown to be exhaustive in terms of information content. Here we instead develop a hierarchical Bayesian approach, expanding the likelihood around the maximum posterior of linear modes, which we solve for using optimization methods. By integrating out the modes using perturbative expansion of the likelihood we construct an initial power spectrum estimator, which for a fixed forward model contains all the cosmological information if the initial modes are gaussian distributed. We develop a method to construct the window and covariance matrix such that the estimator is explicitly unbiased and nearly optimal. We then generalize the method to include the forward model parameters, including cosmological and nuisance parameters, and primordial non-gaussianity. We apply the method in the simplified context of nonlinear structure formation, using either simplified 2-LPT dynamics or N-body simulations as the nonlinear mapping between linear and nonlinear density, and 2-LPT dynamics in the optimization steps used to reconstruct the initial density modes. We demonstrate that the method gives an unbiased estimator of the initial power spectrum, providing among other a near optimal reconstruction of linear baryonic acoustic oscillations.},
doi = {10.1088/1475-7516/2017/12/009},
journal = {Journal of Cosmology and Astroparticle Physics},
number = 12,
volume = 2017,
place = {United States},
year = {Tue Dec 05 00:00:00 EST 2017},
month = {Tue Dec 05 00:00:00 EST 2017}
}
Web of Science
Works referenced in this record:
Improving Cosmological Distance Measurements by Reconstruction of the Baryon Acoustic Peak
journal, August 2007
- Eisenstein, Daniel J.; Seo, Hee‐Jong; Sirko, Edwin
- The Astrophysical Journal, Vol. 664, Issue 2
Power-spectrum analysis of three-dimensional redshift surveys
journal, May 1994
- Feldman, Hume A.; Kaiser, Nick; Peacock, John A.
- The Astrophysical Journal, Vol. 426
Properties and use of CMB power spectrum likelihoods
journal, April 2009
- Hamimeche, Samira; Lewis, Antony
- Physical Review D, Vol. 79, Issue 8
Efficient Wiener filtering without preconditioning
journal, January 2013
- Elsner, F.; Wandelt, B. D.
- Astronomy & Astrophysics, Vol. 549
Measuring the Galaxy Power Spectrum with Future Redshift Surveys
journal, June 1998
- Tegmark, Max; Hamilton, Andrew J. S.; Strauss, Michael A.
- The Astrophysical Journal, Vol. 499, Issue 2
Observational probes of cosmic acceleration
journal, September 2013
- Weinberg, David H.; Mortonson, Michael J.; Eisenstein, Daniel J.
- Physics Reports, Vol. 530, Issue 2
Large-scale structure of the Universe and cosmological perturbation theory
journal, September 2002
- Bernardeau, F.; Colombi, S.; Gaztañaga, E.
- Physics Reports, Vol. 367, Issue 1-3
Cosmography and Power Spectrum Estimation: A Unified Approach
journal, August 1998
- Seljak, Uroš
- The Astrophysical Journal, Vol. 503, Issue 2
Iterative initial condition reconstruction
journal, July 2017
- Schmittfull, Marcel; Baldauf, Tobias; Zaldarriaga, Matias
- Physical Review D, Vol. 96, Issue 2
Estimating CDM particle trajectories in the mildly non-linear regime of structure formation. Implications for the density field in real and redshift space
journal, December 2012
- Tassev, Svetlin; Zaldarriaga, Matias
- Journal of Cosmology and Astroparticle Physics, Vol. 2012, Issue 12
Past and present cosmic structure in the SDSS DR7 main sample
journal, January 2015
- Jasche, J.; Leclercq, F.; Wandelt, B. D.
- Journal of Cosmology and Astroparticle Physics, Vol. 2015, Issue 01
Interpolation, realization, and reconstruction of noisy, irregularly sampled data
journal, October 1992
- Rybicki, George B.; Press, William H.
- The Astrophysical Journal, Vol. 398
Elucid—Exploring the Local Universe with the Reconstructed Initial Density Field. i. Hamiltonian Markov Chain Monte Carlo Method with Particle mesh Dynamics
journal, September 2014
- Wang, Huiyuan; Mo, H. J.; Yang, Xiaohu
- The Astrophysical Journal, Vol. 794, Issue 1
How to measure CMB power spectra without losing information
journal, May 1997
- Tegmark, Max
- Physical Review D, Vol. 55, Issue 10
Estimators for local non-Gaussianities
journal, March 2007
- Creminelli, Paolo; Senatore, Leonardo; Zaldarriaga, Matias
- Journal of Cosmology and Astroparticle Physics, Vol. 2007, Issue 03
Towards optimal measurement of power spectra - I. Minimum variance pair weighting and the Fisher matrix
journal, August 1997
- Hamilton, A. J. S.
- Monthly Notices of the Royal Astronomical Society, Vol. 289, Issue 2
Estimating the power spectrum of the cosmic microwave background
journal, February 1998
- Bond, J. R.; Jaffe, A. H.; Knox, L.
- Physical Review D, Vol. 57, Issue 4
Numerical Optimization
book, January 1999
- Nocedal, Jorge; Wright, Stephen J.
- Springer Series in Operations Research and Financial Engineering
C osmo++: An object-oriented C++ library for cosmology
journal, December 2014
- Aslanyan, Grigor
- Computer Physics Communications, Vol. 185, Issue 12
Statistical Analysis of Catalogs of Extragalactic Objects. I. Theory
journal, October 1973
- Peebles, P. J. E.
- The Astrophysical Journal, Vol. 185
Towards optimal measurement of power spectra - II. A basis of positive, compact, statistically orthogonal kernels
journal, August 1997
- Hamilton, A. J. S.
- Monthly Notices of the Royal Astronomical Society, Vol. 289, Issue 2
Bayesian physical reconstruction of initial conditions from large-scale structure surveys
journal, April 2013
- Jasche, Jens; Wandelt, Benjamin D.
- Monthly Notices of the Royal Astronomical Society, Vol. 432, Issue 2
FastPM: a new scheme for fast simulations of dark matter and haloes
journal, August 2016
- Feng, Yu; Chu, Man-Yat; Seljak, Uroš
- Monthly Notices of the Royal Astronomical Society, Vol. 463, Issue 3
Myths and truths concerning estimation of power spectra: the case for a hybrid estimator
journal, April 2004
- Efstathiou, G.
- Monthly Notices of the Royal Astronomical Society, Vol. 349, Issue 2
Galaxy-galaxy weak lensing in the Sloan Digital Sky Survey: intrinsic alignments and shear calibration errors
journal, September 2004
- Hirata, Christopher M.; Mandelbaum, Rachel; Seljak, Uroš
- Monthly Notices of the Royal Astronomical Society, Vol. 353, Issue 2
Fast Hamiltonian sampling for large-scale structure inference: Fast Hamiltonian sampling
journal, June 2010
- Jasche, Jens; Kitaura, Francisco S.
- Monthly Notices of the Royal Astronomical Society, Vol. 407, Issue 1
Efficient Wiener filtering without preconditioning
text, January 2012
- Elsner, Franz; Wandelt, Benjamin D.
- arXiv
Large-Scale Structure of the Universe and Cosmological Perturbation Theory
text, January 2001
- Bernardeau, F.; Colombi, S.; Gaztanaga, E.
- arXiv
Improving Cosmological Distance Measurements by Reconstruction of the Baryon Acoustic Peak
text, January 2006
- Eisenstein, Daniel J.; Seo, Hee-jong; Sirko, Edwin
- arXiv
Estimating the Power Spectrum of the Cosmic Microwave Background
text, January 1997
- Bond, J. R.; Jaffe, A. H.; Knox, L.
- arXiv
Works referencing / citing this record:
Physical Bayesian modelling of the non-linear matter distribution: New insights into the nearby universe
journal, May 2019
- Jasche, J.; Lavaux, G.
- Astronomy & Astrophysics, Vol. 625
Exploring the posterior surface of the large scale structure reconstruction
journal, July 2018
- Feng, Yu; Seljak, Uroš; Zaldarriaga, Matias
- Journal of Cosmology and Astroparticle Physics, Vol. 2018, Issue 07
Cosmological reconstruction from galaxy light: neural network based light-matter connection
journal, October 2018
- Modi, Chirag; Feng, Yu; Seljak, Uroš
- Journal of Cosmology and Astroparticle Physics, Vol. 2018, Issue 10
A rigorous EFT-based forward model for large-scale structure
journal, January 2019
- Schmidt, Fabian; Elsner, Franz; Jasche, Jens
- Journal of Cosmology and Astroparticle Physics, Vol. 2019, Issue 01
Reconstructing large-scale structure with neutral hydrogen surveys
journal, November 2019
- Modi, Chirag; White, Martin; Slosar, Anže
- Journal of Cosmology and Astroparticle Physics, Vol. 2019, Issue 11
Primordial power spectrum and cosmology from black-box galaxy surveys
journal, October 2019
- Leclercq, Florent; Enzi, Wolfgang; Jasche, Jens
- Monthly Notices of the Royal Astronomical Society, Vol. 490, Issue 3
Cosmological inference from galaxy-clustering power spectrum: Gaussianization and covariance decomposition
journal, March 2019
- Wang, Mike (Shengbo); Percival, Will J.; Avila, Santiago
- Monthly Notices of the Royal Astronomical Society, Vol. 486, Issue 1
Improved renormalization group computation of likelihood functions for cosmological data sets
journal, August 2019
- McDonald, Patrick
- Physical Review D, Vol. 100, Issue 4
Measuring dark matter-neutrino relative velocity on cosmological scales
journal, January 2020
- Zhu, Hong-Ming; Castorina, Emanuele
- Physical Review D, Vol. 101, Issue 2
Nonlinear reconstruction of redshift space distortions
journal, February 2018
- Zhu, Hong-Ming; Yu, Yu; Pen, Ue-Li
- Physical Review D, Vol. 97, Issue 4
Recovering lost 21 cm radial modes via cosmic tidal reconstruction
journal, August 2018
- Zhu, Hong-Ming; Pen, Ue-Li; Yu, Yu
- Physical Review D, Vol. 98, Issue 4
ELUCID. V. Lighting Dark Matter Halos with Galaxies
journal, June 2018
- Yang, Xiaohu; Zhang, Youcai; Wang, Huiyuan
- The Astrophysical Journal, Vol. 860, Issue 1
TARDIS. I. A Constrained Reconstruction Approach to Modeling the z ∼ 2.5 Cosmic Web Probed by Ly α Forest Tomography
journal, December 2019
- Horowitz, Benjamin; Lee, Khee-Gan; White, Martin
- The Astrophysical Journal, Vol. 887, Issue 1
Nonlinear Reconstruction of the Velocity Field
journal, December 2019
- Yu, Yu; Zhu, Hong-Ming
- The Astrophysical Journal, Vol. 887, Issue 2
ELUCID V. Lighting dark matter halos with galaxies
text, January 2017
- Yang, Xiaohu; Zhang, Youcai; Wang, Huiyuan
- arXiv
Exploring the posterior surface of the large scale structure reconstruction
text, January 2018
- Feng, Yu; Seljak, Uros; Zaldarriaga, Matias
- arXiv
Physical Bayesian modelling of the non-linear matter distribution: new insights into the Nearby Universe
text, January 2018
- Jasche, Jens; Lavaux, Guilhem
- arXiv
A rigorous EFT-based forward model for large-scale structure
text, January 2018
- Schmidt, Fabian; Elsner, Franz; Jasche, Jens
- arXiv
Cosmological Inference from Galaxy-Clustering Power Spectrum: Gaussianization and Covariance Decomposition
text, January 2018
- Wang, Mike Shengbo; Percival, Will J.; Avila, Santiago
- arXiv
Galaxy power-spectrum responses and redshift-space super-sample effect
text, January 2017
- Li, Yin; Schmittfull, Marcel; Seljak, Uroš
- arXiv
Renormalization group computation of likelihood functions for cosmological data sets
text, January 2018
- McDonald, Patrick
- arXiv
Learning effective physical laws for generating cosmological hydrodynamics with Lagrangian Deep Learning
text, January 2020
- Dai, Biwei; Seljak, Uros
- arXiv
FlowPM: Distributed TensorFlow Implementation of the FastPM Cosmological N-body Solver
preprint, January 2020
- Modi, Chirag; Lanusse, Francois; Seljak, Uros
- arXiv
MADLens, a python package for fast and differentiable non-Gaussian lensing simulations
preprint, January 2020
- Böhm, Vanessa; Feng, Yu; Lee, Max E.
- arXiv
Learning to Simulate High Energy Particle Collisions from Unlabeled Data
text, January 2021
- Howard, Jessica N.; Mandt, Stephan; Whiteson, Daniel
- arXiv