DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Data compression and covariance matrix inspection: Cosmic shear

Abstract

Covariance matrices are among the most difficult pieces of end-to-end cosmological analyses. In principle, for two-point functions, each component involves a four-point function, and the resulting covariance often has hundreds of thousands of elements. We investigate various compression mechanisms capable of vastly reducing the size of the covariance matrix in the context of cosmic shear statistics. This helps identify which of its parts are most crucial to parameter estimation. We start with simple compression methods, by isolating and “removing” 200 modes associated with the lowest eigenvalues, then those with the lowest signal-to-noise ratio, before moving on to more sophisticated schemes like compression at the tomographic level and, finally, with the massively optimized parameter estimation and data compression (MOPED). We find that, while most of these approaches prove useful for a few parameters of interest, like Ωm, the simplest yield a loss of constraining power on the intrinsic alignment (IA) parameters as well as S8. For the case considered—cosmic shear from the first year of data from the Dark Energy Survey—only MOPED was able to replicate the original constraints in the 16-parameter space. Finally, we apply a tolerance test to the elements of the compressed covariance matrix obtained with MOPED andmore » confirm that the IA parameter AIA is the most susceptible to inaccuracies in the covariance matrix.« less

Authors:
ORCiD logo [1];  [2]; ORCiD logo [2]; ORCiD logo [2]
  1. Carnegie Mellon Univ., Pittsburgh, PA (United States); Univ. Federal do Espirito Santo, Vitoria (Brazil); Lab. Interinstitucional de e-Astronomia—LIneA, Rio de Janeiro (Brazil)
  2. Carnegie Mellon Univ., Pittsburgh, PA (United States)
Publication Date:
Research Org.:
Carnegie Mellon Univ., Pittsburgh, PA (United States)
Sponsoring Org.:
USDOE Office of Science (SC)
Contributing Org.:
LSST Dark Energy Science Collaboration
OSTI Identifier:
1837674
Grant/Contract Number:  
SC0010118; AC02-05CH11231; AC02-76SF00515
Resource Type:
Accepted Manuscript
Journal Name:
Physical Review D
Additional Journal Information:
Journal Volume: 103; Journal Issue: 10; Journal ID: ISSN 2470-0010
Publisher:
American Physical Society (APS)
Country of Publication:
United States
Language:
English
Subject:
79 ASTRONOMY AND ASTROPHYSICS; Cosmology; Large scale structure of the Universe

Citation Formats

Ferreira, Tassia, Zhang, Tianqing, Chen, Nianyi, and Dodelson, Scott. Data compression and covariance matrix inspection: Cosmic shear. United States: N. p., 2021. Web. doi:10.1103/physrevd.103.103535.
Ferreira, Tassia, Zhang, Tianqing, Chen, Nianyi, & Dodelson, Scott. Data compression and covariance matrix inspection: Cosmic shear. United States. https://doi.org/10.1103/physrevd.103.103535
Ferreira, Tassia, Zhang, Tianqing, Chen, Nianyi, and Dodelson, Scott. Fri . "Data compression and covariance matrix inspection: Cosmic shear". United States. https://doi.org/10.1103/physrevd.103.103535. https://www.osti.gov/servlets/purl/1837674.
@article{osti_1837674,
title = {Data compression and covariance matrix inspection: Cosmic shear},
author = {Ferreira, Tassia and Zhang, Tianqing and Chen, Nianyi and Dodelson, Scott},
abstractNote = {Covariance matrices are among the most difficult pieces of end-to-end cosmological analyses. In principle, for two-point functions, each component involves a four-point function, and the resulting covariance often has hundreds of thousands of elements. We investigate various compression mechanisms capable of vastly reducing the size of the covariance matrix in the context of cosmic shear statistics. This helps identify which of its parts are most crucial to parameter estimation. We start with simple compression methods, by isolating and “removing” 200 modes associated with the lowest eigenvalues, then those with the lowest signal-to-noise ratio, before moving on to more sophisticated schemes like compression at the tomographic level and, finally, with the massively optimized parameter estimation and data compression (MOPED). We find that, while most of these approaches prove useful for a few parameters of interest, like Ωm, the simplest yield a loss of constraining power on the intrinsic alignment (IA) parameters as well as S8. For the case considered—cosmic shear from the first year of data from the Dark Energy Survey—only MOPED was able to replicate the original constraints in the 16-parameter space. Finally, we apply a tolerance test to the elements of the compressed covariance matrix obtained with MOPED and confirm that the IA parameter AIA is the most susceptible to inaccuracies in the covariance matrix.},
doi = {10.1103/physrevd.103.103535},
journal = {Physical Review D},
number = 10,
volume = 103,
place = {United States},
year = {Fri May 28 00:00:00 EDT 2021},
month = {Fri May 28 00:00:00 EDT 2021}
}

Works referenced in this record:

Science-driven 3D data compression
journal, October 2017

  • Alonso, David
  • Monthly Notices of the Royal Astronomical Society, Vol. 473, Issue 4
  • DOI: 10.1093/mnras/stx2644

Massive data compression for parameter-dependent covariance matrices
journal, September 2017

  • Heavens, Alan F.; Sellentin, Elena; de Mijolla, Damien
  • Monthly Notices of the Royal Astronomical Society, Vol. 472, Issue 4
  • DOI: 10.1093/mnras/stx2326

Karhunen‐Loeve Eigenvalue Problems in Cosmology: How Should We Tackle Large Data Sets?
journal, May 1997

  • Tegmark, Max; Taylor, Andy N.; Heavens, Alan F.
  • The Astrophysical Journal, Vol. 480, Issue 1
  • DOI: 10.1086/303939

Extreme data compression for the CMB
journal, April 2016


Eigenmode Analysis of Galaxy Redshift Surveys. I. Theory and Methods
journal, July 1996

  • Vogeley, Michael S.; Szalay, Alexander S.
  • The Astrophysical Journal, Vol. 465
  • DOI: 10.1086/177399

Dark Energy Survey Year 1 results: Cosmological constraints from cosmic shear
journal, August 2018


Efficient Computation of Cosmic Microwave Background Anisotropies in Closed Friedmann‐Robertson‐Walker Models
journal, August 2000

  • Lewis, Antony; Challinor, Anthony; Lasenby, Anthony
  • The Astrophysical Journal, Vol. 538, Issue 2
  • DOI: 10.1086/309179

CMB power spectrum parameter degeneracies in the era of precision cosmology
journal, April 2012

  • Howlett, Cullan; Lewis, Antony; Hall, Alex
  • Journal of Cosmology and Astroparticle Physics, Vol. 2012, Issue 04
  • DOI: 10.1088/1475-7516/2012/04/027

Dark Energy Survey year 1 results: Cosmological constraints from galaxy clustering and weak lensing
journal, August 2018


Stable clustering, the halo model and non-linear cosmological power spectra
journal, June 2003


Revising the Halofit Model for the Nonlinear Matter Power Spectrum
journal, December 2012

  • Takahashi, Ryuichi; Sato, Masanori; Nishimichi, Takahiro
  • The Astrophysical Journal, Vol. 761, Issue 2
  • DOI: 10.1088/0004-637X/761/2/152

Parameter inference for weak lensing using Gaussian Processes and MOPED
journal, July 2020

  • Mootoovaloo, Arrykrishna; Heavens, Alan F.; Jaffe, Andrew H.
  • Monthly Notices of the Royal Astronomical Society, Vol. 497, Issue 2
  • DOI: 10.1093/mnras/staa2102

Structural equation modeling with near singular covariance matrices
journal, June 2008


KiDS-450: the tomographic weak lensing power spectrum and constraints on cosmological parameters
journal, July 2017

  • Köhlinger, F.; Viola, M.; Joachimi, B.
  • Monthly Notices of the Royal Astronomical Society, Vol. 471, Issue 4
  • DOI: 10.1093/mnras/stx1820

The impact of signal-to-noise, redshift, and angular range on the bias of weak lensing 2-point functions
journal, September 2020


CosmoSIS: Modular cosmological parameter estimation
journal, September 2015


Dark energy constraints from cosmic shear power spectra: impact of intrinsic alignments on photometric redshift requirements
journal, December 2007


Dark-energy constraints and correlations with systematics from CFHTLS weak lensing, SNLS supernovae Ia and WMAP5
journal, March 2009


cosmolike – cosmological likelihood analyses for photometric galaxy surveys
journal, May 2017

  • Krause, Elisabeth; Eifler, Tim
  • Monthly Notices of the Royal Astronomical Society, Vol. 470, Issue 2
  • DOI: 10.1093/mnras/stx1261

Sheer shear: weak lensing with one mode
journal, December 2019

  • Bellini, Emilio; van Waerbeke, Ludovic; Joudaki, Shahab
  • The Open Journal of Astrophysics, Vol. 2, Issue 1
  • DOI: 10.21105/astro.1903.04957

Data compression in cosmology: A compressed likelihood for Planck data
journal, October 2019


The cosmological impact of intrinsic alignment model choice for cosmic shear
journal, August 2012


MultiNest: an efficient and robust Bayesian inference tool for cosmology and particle physics
journal, October 2009


Massive lossless data compression and multiple parameter estimation from galaxy spectra
journal, October 2000


Compressing combined probes: redshift weights for joint lensing and clustering analyses
journal, August 2020

  • Ruggeri, Rossana; Blake, Chris
  • Monthly Notices of the Royal Astronomical Society, Vol. 498, Issue 2
  • DOI: 10.1093/mnras/staa2537

KiDS-1000 methodology: Modelling and inference for joint weak gravitational lensing and spectroscopic galaxy clustering analysis
journal, February 2021


Maximal compression of the redshift-space galaxy power spectrum and bispectrum
journal, January 2018

  • Gualdi, Davide; Manera, Marc; Joachimi, Benjamin
  • Monthly Notices of the Royal Astronomical Society, Vol. 476, Issue 3
  • DOI: 10.1093/mnras/sty261