Performance of internal covariance estimators for cosmic shear correlation functions
Abstract
Data re-sampling methods such as the delete-one jackknife are a common tool for estimating the covariance of large scale structure probes. In this paper we investigate the concepts of internal covariance estimation in the context of cosmic shear two-point statistics. We demonstrate how to use log-normal simulations of the convergence field and the corresponding shear field to carry out realistic tests of internal covariance estimators and find that most estimators such as jackknife or sub-sample covariance can reach a satisfactory compromise between bias and variance of the estimated covariance. In a forecast for the complete, 5-year DES survey we show that internally estimated covariance matrices can provide a large fraction of the true uncertainties on cosmological parameters in a 2D cosmic shear analysis. The volume inside contours of constant likelihood in the $$\Omega_m$$-$$\sigma_8$$ plane as measured with internally estimated covariance matrices is on average $$\gtrsim 85\%$$ of the volume derived from the true covariance matrix. The uncertainty on the parameter combination $$\Sigma_8 \sim \sigma_8 \Omega_m^{0.5}$$ derived from internally estimated covariances is $$\sim 90\%$$ of the true uncertainty.
- Authors:
-
- Univ. Observatory Munich, Munich (Germany); Max Planck Institute for Extraterrestrial Physics, Garching (Germany)
- California Institute of Technology, Pasadena, CA (United States)
- Publication Date:
- Research Org.:
- Fermi National Accelerator Lab. (FNAL), Batavia, IL (United States)
- Sponsoring Org.:
- USDOE Office of Science (SC), High Energy Physics (HEP)
- OSTI Identifier:
- 1254158
- Report Number(s):
- arXiv:1508.00895; FERMILAB-PUB-16-182-AE
Journal ID: ISSN 0035-8711; 1386645
- Grant/Contract Number:
- AC02-07CH11359
- Resource Type:
- Accepted Manuscript
- Journal Name:
- Monthly Notices of the Royal Astronomical Society
- Additional Journal Information:
- Journal Volume: 456; Journal Issue: 3; Journal ID: ISSN 0035-8711
- Publisher:
- Royal Astronomical Society
- Country of Publication:
- United States
- Language:
- English
- Subject:
- 79 ASTRONOMY AND ASTROPHYSICS; methods: data analysis; methods: statistical; cosmological parameters; large-scale structure of Universe; cosmic shear; covariance; jackknife; angular correlation function
Citation Formats
Friedrich, O., Seitz, S., Eifler, T. F., and Gruen, D. Performance of internal covariance estimators for cosmic shear correlation functions. United States: N. p., 2015.
Web. doi:10.1093/mnras/stv2833.
Friedrich, O., Seitz, S., Eifler, T. F., & Gruen, D. Performance of internal covariance estimators for cosmic shear correlation functions. United States. https://doi.org/10.1093/mnras/stv2833
Friedrich, O., Seitz, S., Eifler, T. F., and Gruen, D. Thu .
"Performance of internal covariance estimators for cosmic shear correlation functions". United States. https://doi.org/10.1093/mnras/stv2833. https://www.osti.gov/servlets/purl/1254158.
@article{osti_1254158,
title = {Performance of internal covariance estimators for cosmic shear correlation functions},
author = {Friedrich, O. and Seitz, S. and Eifler, T. F. and Gruen, D.},
abstractNote = {Data re-sampling methods such as the delete-one jackknife are a common tool for estimating the covariance of large scale structure probes. In this paper we investigate the concepts of internal covariance estimation in the context of cosmic shear two-point statistics. We demonstrate how to use log-normal simulations of the convergence field and the corresponding shear field to carry out realistic tests of internal covariance estimators and find that most estimators such as jackknife or sub-sample covariance can reach a satisfactory compromise between bias and variance of the estimated covariance. In a forecast for the complete, 5-year DES survey we show that internally estimated covariance matrices can provide a large fraction of the true uncertainties on cosmological parameters in a 2D cosmic shear analysis. The volume inside contours of constant likelihood in the $\Omega_m$-$\sigma_8$ plane as measured with internally estimated covariance matrices is on average $\gtrsim 85\%$ of the volume derived from the true covariance matrix. The uncertainty on the parameter combination $\Sigma_8 \sim \sigma_8 \Omega_m^{0.5}$ derived from internally estimated covariances is $\sim 90\%$ of the true uncertainty.},
doi = {10.1093/mnras/stv2833},
journal = {Monthly Notices of the Royal Astronomical Society},
number = 3,
volume = 456,
place = {United States},
year = {Thu Dec 31 00:00:00 EST 2015},
month = {Thu Dec 31 00:00:00 EST 2015}
}
Web of Science
Works referenced in this record:
Error analysis in cross-correlation of sky maps: application to the Integrated Sachs-Wolfe detection
journal, November 2007
- Cabre, A.; Fosalba, P.; Gaztanaga, E.
- Monthly Notices of the Royal Astronomical Society, Vol. 381, Issue 4
Power Spectrum Covariance of Weak Gravitational Lensing
journal, June 2001
- Cooray, Asantha; Hu, Wayne
- The Astrophysical Journal, Vol. 554, Issue 1
Modelling the angular correlation function and its full covariance in photometric galaxy surveys: Angular clustering in photometric surveys
journal, March 2011
- Crocce, Martín; Cabré, Anna; Gaztañaga, Enrique
- Monthly Notices of the Royal Astronomical Society, Vol. 414, Issue 1
Large-scale analysis of the SDSS-III DR8 photometric luminous galaxies angular correlation function
journal, September 2013
- de Simoni, Fernando; Sobreira, Flávia; Carnero, Aurelio
- Monthly Notices of the Royal Astronomical Society, Vol. 435, Issue 4
Dependence of cosmic shear covariances on cosmology: Impact on parameter estimation
journal, June 2009
- Eifler, T.; Schneider, P.; Hartlap, J.
- Astronomy & Astrophysics, Vol. 502, Issue 3
Combining probes of large-scale structure with CosmoLike
journal, March 2014
- Eifler, Tim; Krause, Elisabeth; Schneider, Peter
- Monthly Notices of the Royal Astronomical Society, Vol. 440, Issue 2
The Dark Energy Survey
journal, June 2005
- Flaugher, Brenna
- International Journal of Modern Physics A, Vol. 20, Issue 14
Simulations of weak gravitational lensing – II. Including finite support effects in cosmic shear covariance matrices
journal, May 2015
- Harnois-Déraps, Joachim; van Waerbeke, Ludovic
- Monthly Notices of the Royal Astronomical Society, Vol. 450, Issue 3
Why your model parameter confidences might be too optimistic. Unbiased estimation of the inverse covariance matrix
journal, December 2006
- Hartlap, J.; Simon, P.; Schneider, P.
- Astronomy & Astrophysics, Vol. 464, Issue 1
Cosmic shear covariance: the log-normal approximation
journal, December 2011
- Hilbert, S.; Hartlap, J.; Schneider, P.
- Astronomy & Astrophysics, Vol. 536
The skewness of the aperture mass statistic
journal, July 2004
- Jarvis, M.; Bernstein, G.; Jain, B.
- Monthly Notices of the Royal Astronomical Society, Vol. 352, Issue 1
Analysis of two-point statistics of cosmic shear: III. Covariances of shear measures made easy
journal, November 2007
- Joachimi, B.; Schneider, P.; Eifler, T.
- Astronomy & Astrophysics, Vol. 477, Issue 1
Mapping the dark matter with weak gravitational lensing
journal, February 1993
- Kaiser, Nick; Squires, Gordon
- The Astrophysical Journal, Vol. 404
Analysis of two-point statistics of cosmic shear: II. Optimizing the survey geometry
journal, December 2003
- Kilbinger, M.; Schneider, P.
- Astronomy & Astrophysics, Vol. 413, Issue 2
Dark-energy constraints and correlations with systematics from CFHTLS weak lensing, SNLS supernovae Ia and WMAP5
journal, March 2009
- Kilbinger, M.; Benabed, K.; Guy, J.
- Astronomy & Astrophysics, Vol. 497, Issue 3
CFHTLenS: combined probe cosmological model comparison using 2D weak gravitational lensing
journal, February 2013
- Kilbinger, Martin; Fu, Liping; Heymans, Catherine
- Monthly Notices of the Royal Astronomical Society, Vol. 430, Issue 3
A Valid and Fast Spatial Bootstrap for Correlation Functions
journal, July 2008
- Loh, Ji Meng
- The Astrophysical Journal, Vol. 681, Issue 1
The bispectrum covariance beyond Gaussianity: A log-normal approach
journal, March 2012
- Martin, S.; Schneider, P.; Simon, P.
- Astronomy & Astrophysics, Vol. 540
Statistical analysis of galaxy surveys - I. Robust error estimation for two-point clustering statistics
journal, June 2009
- Norberg, P.; Baugh, C. M.; Gaztañaga, E.
- Monthly Notices of the Royal Astronomical Society, Vol. 396, Issue 1
Simulations of Wide-Field weak Lensing Surveys. i. Basic Statistics and Non-Gaussian Effects
journal, July 2009
- Sato, Masanori; Hamana, Takashi; Takahashi, Ryuichi
- The Astrophysical Journal, Vol. 701, Issue 2
Simulations of Wide-Field Weak-Lensing Surveys. ii. Covariance Matrix of Real-Space Correlation Functions
journal, May 2011
- Sato, Masanori; Takada, Masahiro; Hamana, Takashi
- The Astrophysical Journal, Vol. 734, Issue 2
Analysis of two-point statistics of cosmic shear: I. Estimators and covariances
journal, November 2002
- Schneider, P.; van Waerbeke, L.; Kilbinger, M.
- Astronomy & Astrophysics, Vol. 396, Issue 1
Cosmic variance of weak lensing surveys in the non-Gaussian regime
journal, February 2007
- Semboloni, E.; Van Waerbeke, L.; Heymans, C.
- Monthly Notices of the Royal Astronomical Society: Letters, Vol. 375, Issue 1
The covariance of cosmic shear correlation functions and cosmological parameter estimates using redshift information
journal, March 2004
- Simon, P.; King, L. J.; Schneider, P.
- Astronomy & Astrophysics, Vol. 417, Issue 3
Stable clustering, the halo model and non-linear cosmological power spectra
journal, June 2003
- Smith, R. E.; Peacock, J. A.; Jenkins, A.
- Monthly Notices of the Royal Astronomical Society, Vol. 341, Issue 4
The impact of non-Gaussian errors on weak lensing surveys
journal, June 2009
- Takada, Masahiro; Jain, Bhuvnesh
- Monthly Notices of the Royal Astronomical Society, Vol. 395, Issue 4
Simulations of Baryon Acoustic Oscillations. ii. Covariance Matrix of the Matter Power Spectrum
journal, July 2009
- Takahashi, Ryuichi; Yoshida, Naoki; Takada, Masahiro
- The Astrophysical Journal, Vol. 700, Issue 1
An optimal survey geometry of weak lensing survey: minimizing supersample covariance
journal, September 2014
- Takahashi, Ryuichi; Soma, Shunji; Takada, Masahiro
- Monthly Notices of the Royal Astronomical Society, Vol. 444, Issue 4
Lognormal Property of Weak‐Lensing Fields
journal, June 2002
- Taruya, Atsushi; Takada, Masahiro; Hamana, Takashi
- The Astrophysical Journal, Vol. 571, Issue 2
Estimating cosmological parameter covariance
journal, June 2014
- Taylor, A.; Joachimi, B.
- Monthly Notices of the Royal Astronomical Society, Vol. 442, Issue 3
Putting the precision in precision cosmology: How accurate should your data covariance matrix be?
journal, May 2013
- Taylor, A.; Joachimi, B.; Kitching, T.
- Monthly Notices of the Royal Astronomical Society, Vol. 432, Issue 3
The angular power spectra of photometric Sloan Digital Sky Survey luminous red galaxies: The angular power spectra of photometric LRGs
journal, February 2011
- Thomas, Shaun A.; Abdalla, Filipe B.; Lahav, Ofer
- Monthly Notices of the Royal Astronomical Society, Vol. 412, Issue 3
Simulating Weak Lensing by Large‐Scale Structure
journal, August 2003
- Vale, Chris; White, Martin
- The Astrophysical Journal, Vol. 592, Issue 2
The SDSS galaxy angular two-point correlation function
journal, May 2013
- Wang, Y.; Brunner, R. J.; Dolence, J. C.
- Monthly Notices of the Royal Astronomical Society, Vol. 432, Issue 3
Works referencing / citing this record:
Angular Baryon Acoustic Oscillation measure at z =2.225 from the SDSS quasar survey
journal, April 2018
- de Carvalho, E.; Bernui, A.; Carvalho, G. C.
- Journal of Cosmology and Astroparticle Physics, Vol. 2018, Issue 04
Joint measurement of lensing–galaxy correlations using SPT and DES SV data
journal, July 2016
- Baxter, E.; Clampitt, J.; Giannantonio, T.
- Monthly Notices of the Royal Astronomical Society, Vol. 461, Issue 4
CFHTLenS revisited: assessing concordance with Planck including astrophysical systematics
journal, October 2016
- Joudaki, Shahab; Blake, Chris; Heymans, Catherine
- Monthly Notices of the Royal Astronomical Society, Vol. 465, Issue 2
KiDS-450: cosmological parameter constraints from tomographic weak gravitational lensing
journal, November 2016
- Hildebrandt, H.; Viola, M.; Heymans, C.
- Monthly Notices of the Royal Astronomical Society, Vol. 465, Issue 2
Dark Energy Survey Year 1 results: weak lensing mass calibration of redMaPPer galaxy clusters
journal, October 2018
- McClintock, T.; Varga, T. N.; Gruen, D.
- Monthly Notices of the Royal Astronomical Society, Vol. 482, Issue 1
Luminous red galaxies in the Kilo-Degree Survey: selection with broad-band photometry and weak lensing measurements
journal, May 2019
- Vakili, Mohammadjavad; Bilicki, Maciej; Hoekstra, Henk
- Monthly Notices of the Royal Astronomical Society, Vol. 487, Issue 3
Covariance matrices for galaxy cluster weak lensing: from virial regime to uncorrelated large-scale structure
journal, September 2019
- Wu, Hao-Yi; Weinberg, David H.; Salcedo, Andrés N.
- Monthly Notices of the Royal Astronomical Society, Vol. 490, Issue 2
Cosmology from cosmic shear power spectra with Subaru Hyper Suprime-Cam first-year data
journal, March 2019
- Hikage, Chiaki; Oguri, Masamune; Hamana, Takashi
- Publications of the Astronomical Society of Japan, Vol. 71, Issue 2
CFHTLenS revisited: assessing concordance with Planck including astrophysical systematics
text, January 2016
- Joudaki, Shahab; Blake, Chris; Heymans, Catherine
- arXiv
KiDS-450: Cosmological parameter constraints from tomographic weak gravitational lensing
text, January 2016
- Hildebrandt, H.; Viola, M.; Heymans, C.
- arXiv
Density split statistics: Cosmological constraints from counts and lensing in cells in DES Y1 and SDSS data
text, January 2017
- Gruen, D.; Friedrich, O.; Krause, E.
- arXiv
Dark Energy Survey Year 1 Results: Weak Lensing Mass Calibration of redMaPPer Galaxy Clusters
text, January 2018
- McClintock, T.; Varga, T. N.; Gruen, D.
- arXiv
Cosmology from cosmic shear power spectra with Subaru Hyper Suprime-Cam first-year data
text, January 2018
- Hikage, Chiaki; Oguri, Masamune; Hamana, Takashi
- arXiv
Covariance matrices for galaxy cluster weak lensing: from virial regime to uncorrelated large-scale structure
text, January 2019
- Wu, Hao-Yi; Weinberg, David H.; Salcedo, Andrés N.
- arXiv