Sample variance in weak lensing: How many simulations are required?
Abstract
Constraining cosmology using weak gravitational lensing consists of comparing a measured feature vector of dimension Nb with its simulated counterpart. An accurate estimate of the Nb × Nb feature covariance matrix C is essential to obtain accurate parameter confidence intervals. When C is measured from a set of simulations, an important question is how large this set should be. To answer this question, we construct different ensembles of Nr realizations of the shear field, using a common randomization procedure that recycles the outputs from a smaller number Ns ≤ Nr of independent ray-tracing N-body simulations. We study parameter confidence intervals as a function of (Ns, Nr) in the range 1 ≤ Ns ≤ 200 and 1 ≤ Nr ≲ 105. Previous work [S. Dodelson and M. D. Schneider, Phys. Rev. D 88, 063537 (2013)] has shown that Gaussian noise in the feature vectors (from which the covariance is estimated) lead, at quadratic order, to an O(1/Nr) degradation of the parameter confidence intervals. Using a variety of lensing features measured in our simulations, including shear-shear power spectra and peak counts, we show that cubic and quartic covariance fluctuations lead to additional O(1/N2r) error degradation that is not negligible when Nr ismore »
- Authors:
-
- Columbia Univ., New York, NY (United States); Brookhaven National Lab. (BNL), Upton, NY (United States)
- Brookhaven National Lab. (BNL), Upton, NY (United States)
- Columbia Univ., New York, NY (United States)
- Publication Date:
- Research Org.:
- Brookhaven National Lab. (BNL), Upton, NY (United States)
- Sponsoring Org.:
- USDOE Office of Science (SC), High Energy Physics (HEP)
- OSTI Identifier:
- 1245392
- Alternate Identifier(s):
- OSTI ID: 1243154
- Report Number(s):
- BNL-111951-2016-JA
Journal ID: ISSN 2470-0010; PRVDAQ; KA2301020
- Grant/Contract Number:
- SC00112704; AC02-98CH10886; SC0012704; ACI-1053575
- Resource Type:
- Accepted Manuscript
- Journal Name:
- Physical Review D
- Additional Journal Information:
- Journal Volume: 93; Journal Issue: 6; Journal ID: ISSN 2470-0010
- Publisher:
- American Physical Society (APS)
- Country of Publication:
- United States
- Language:
- English
- Subject:
- 79 ASTRONOMY AND ASTROPHYSICS
Citation Formats
Petri, Andrea, May, Morgan, and Haiman, Zoltan. Sample variance in weak lensing: How many simulations are required?. United States: N. p., 2016.
Web. doi:10.1103/PhysRevD.93.063524.
Petri, Andrea, May, Morgan, & Haiman, Zoltan. Sample variance in weak lensing: How many simulations are required?. United States. https://doi.org/10.1103/PhysRevD.93.063524
Petri, Andrea, May, Morgan, and Haiman, Zoltan. Thu .
"Sample variance in weak lensing: How many simulations are required?". United States. https://doi.org/10.1103/PhysRevD.93.063524. https://www.osti.gov/servlets/purl/1245392.
@article{osti_1245392,
title = {Sample variance in weak lensing: How many simulations are required?},
author = {Petri, Andrea and May, Morgan and Haiman, Zoltan},
abstractNote = {Constraining cosmology using weak gravitational lensing consists of comparing a measured feature vector of dimension Nb with its simulated counterpart. An accurate estimate of the Nb × Nb feature covariance matrix C is essential to obtain accurate parameter confidence intervals. When C is measured from a set of simulations, an important question is how large this set should be. To answer this question, we construct different ensembles of Nr realizations of the shear field, using a common randomization procedure that recycles the outputs from a smaller number Ns ≤ Nr of independent ray-tracing N-body simulations. We study parameter confidence intervals as a function of (Ns, Nr) in the range 1 ≤ Ns ≤ 200 and 1 ≤ Nr ≲ 105. Previous work [S. Dodelson and M. D. Schneider, Phys. Rev. D 88, 063537 (2013)] has shown that Gaussian noise in the feature vectors (from which the covariance is estimated) lead, at quadratic order, to an O(1/Nr) degradation of the parameter confidence intervals. Using a variety of lensing features measured in our simulations, including shear-shear power spectra and peak counts, we show that cubic and quartic covariance fluctuations lead to additional O(1/N2r) error degradation that is not negligible when Nr is only a factor of few larger than Nb. We study the large Nr limit, and find that a single, 240 Mpc/h sized 5123-particle N-body simulation (Ns = 1) can be repeatedly recycled to produce as many as Nr = few × 104 shear maps whose power spectra and high-significance peak counts can be treated as statistically independent. Lastly, a small number of simulations (Ns = 1 or 2) is sufficient to forecast parameter confidence intervals at percent accuracy.},
doi = {10.1103/PhysRevD.93.063524},
journal = {Physical Review D},
number = 6,
volume = 93,
place = {United States},
year = {Thu Mar 24 00:00:00 EDT 2016},
month = {Thu Mar 24 00:00:00 EDT 2016}
}
Web of Science
Works referenced in this record:
CFHTLenS: the Canada–France–Hawaii Telescope Lensing Survey: CFHTLenS
journal, October 2012
- Heymans, Catherine; Van Waerbeke, Ludovic; Miller, Lance
- Monthly Notices of the Royal Astronomical Society, Vol. 427, Issue 1
Bayesian galaxy shape measurement for weak lensing surveys – III. Application to the Canada–France–Hawaii Telescope Lensing Survey
journal, January 2013
- Miller, L.; Heymans, C.; Kitching, T. D.
- Monthly Notices of the Royal Astronomical Society, Vol. 429, Issue 4
The COSMOS Survey: Hubble Space Telescope Advanced Camera for Surveys Observations and Data Processing
journal, September 2007
- Koekemoer, A. M.; Aussel, H.; Calzetti, D.
- The Astrophysical Journal Supplement Series, Vol. 172, Issue 1
Baryon impact on weak lensing peaks and power spectrum: Low-bias statistics and self-calibration in future surveys
journal, January 2013
- Yang, Xiuyuan; Kratochvil, Jan M.; Huffenberger, Kevin
- Physical Review D, Vol. 87, Issue 2
Effect of baryonic feedback on two- and three-point shear statistics: prospects for detection and improved modelling
journal, July 2013
- Semboloni, E.; Hoekstra, H.; Schaye, J.
- Monthly Notices of the Royal Astronomical Society, Vol. 434, Issue 1
Baryons and weak lensing power spectra
journal, November 2004
- White, Martin
- Astroparticle Physics, Vol. 22, Issue 2
Effect of Hot Baryons on the Weak-Lensing Shear Power Spectrum
journal, October 2004
- Zhan, Hu; Knox, Lloyd
- The Astrophysical Journal, Vol. 616, Issue 2
Self-calibration of tomographic weak lensing for the physics of baryons to constrain dark energy
journal, February 2008
- Zentner, Andrew R.; Rudd, Douglas H.; Hu, Wayne
- Physical Review D, Vol. 77, Issue 4
Effects of Baryons and Dissipation on the Matter Power Spectrum
journal, January 2008
- Rudd, Douglas H.; Zentner, Andrew R.; Kravtsov, Andrey V.
- The Astrophysical Journal, Vol. 672, Issue 1
Cosmological information in weak lensing peaks
journal, August 2011
- Yang, Xiuyuan; Kratochvil, Jan M.; Wang, Sheng
- Physical Review D, Vol. 84, Issue 4
Probing cosmology with weak lensing Minkowski functionals
journal, May 2012
- Kratochvil, Jan M.; Lim, Eugene A.; Wang, Sheng
- Physical Review D, Vol. 85, Issue 10
Cosmology with Minkowski functionals and moments of the weak lensing convergence field
journal, December 2013
- Petri, Andrea; Haiman, Zoltán; Hui, Lam
- Physical Review D, Vol. 88, Issue 12
The Cosmology Dependence of weak Lensing Cluster Counts
journal, May 2009
- Marian, Laura; Smith, Robert E.; Bernstein, Gary M.
- The Astrophysical Journal, Vol. 698, Issue 1
The kurtosis of the cosmic shear field
journal, December 2002
- Takada, M.; Jain, B.
- Monthly Notices of the Royal Astronomical Society, Vol. 337, Issue 3
Three-point correlations in weak lensing surveys: model predictions and applications
journal, September 2003
- Takada, Masahiro; Jain, Bhuvnesh
- Monthly Notices of the Royal Astronomical Society, Vol. 344, Issue 3
Cosmological parameters from lensing power spectrum and bispectrum tomography
journal, March 2004
- Takada, Masahiro; Jain, Bhuvnesh
- Monthly Notices of the Royal Astronomical Society, Vol. 348, Issue 3
Optimal Capture of Non-Gaussianity in Weak-Lensing Surveys: Power Spectrum, Bispectrum, and halo Counts
journal, March 2010
- Bergé, Joel; Amara, Adam; Réfrégier, Alexandre
- The Astrophysical Journal, Vol. 712, Issue 2
Cosmology with the shear-peak statistics
journal, February 2010
- Dietrich, J. P.; Hartlap, J.
- Monthly Notices of the Royal Astronomical Society, Vol. 402, Issue 2
Effect of Masked Regions on Weak-Lensing Statistics
journal, August 2013
- Shirasaki, Masato; Yoshida, Naoki; Hamana, Takashi
- The Astrophysical Journal, Vol. 774, Issue 2
Effect of Measurement Errors on Predicted Cosmological Constraints from Shear peak Statistics with Large Synoptic Survey Telescope
journal, August 2013
- Bard, D.; Kratochvil, J. M.; Chang, C.
- The Astrophysical Journal, Vol. 774, Issue 1
Spurious shear in weak lensing with the Large Synoptic Survey Telescope
journal, November 2012
- Chang, C.; Kahn, S. M.; Jernigan, J. G.
- Monthly Notices of the Royal Astronomical Society, Vol. 428, Issue 3
Systematic errors in future weak-lensing surveys: requirements and prospects for self-calibration
journal, February 2006
- Huterer, D.; Takada, M.; Bernstein, G.
- Monthly Notices of the Royal Astronomical Society, Vol. 366, Issue 1
Putting the precision in precision cosmology: How accurate should your data covariance matrix be?
journal, May 2013
- Taylor, A.; Joachimi, B.; Kitching, T.
- Monthly Notices of the Royal Astronomical Society, Vol. 432, Issue 3
The cosmological simulation code gadget-2
journal, December 2005
- Springel, Volker
- Monthly Notices of the Royal Astronomical Society, Vol. 364, Issue 4
Ray-tracing through the Millennium Simulation: Born corrections and lens-lens coupling in cosmic shear and galaxy-galaxy lensing
journal, March 2009
- Hilbert, S.; Hartlap, J.; White, S. D. M.
- Astronomy & Astrophysics, Vol. 499, Issue 1
Ray‐tracing Simulations of Weak Lensing by Large‐Scale Structure
journal, February 2000
- Jain, Bhuvnesh; Seljak, Uroš; White, Simon
- The Astrophysical Journal, Vol. 530, Issue 2
Simulations of Wide-Field weak Lensing Surveys. i. Basic Statistics and Non-Gaussian Effects
journal, July 2009
- Sato, Masanori; Hamana, Takashi; Takahashi, Ryuichi
- The Astrophysical Journal, Vol. 701, Issue 2
The Coyote Universe. ii. Cosmological Models and Precision Emulation of the Nonlinear Matter Power Spectrum
journal, October 2009
- Heitmann, Katrin; Higdon, David; White, Martin
- The Astrophysical Journal, Vol. 705, Issue 1
Dark-energy constraints and correlations with systematics from CFHTLS weak lensing, SNLS supernovae Ia and WMAP5
journal, March 2009
- Kilbinger, M.; Benabed, K.; Guy, J.
- Astronomy & Astrophysics, Vol. 497, Issue 3
Simulations and cosmological inference: A statistical model for power spectra means and covariances
journal, September 2008
- Schneider, Michael D.; Knox, Lloyd; Habib, Salman
- Physical Review D, Vol. 78, Issue 6
General Moments of the Inverse Real Wishart Distribution and Orthogonal Weingarten Functions
journal, January 2011
- Matsumoto, Sho
- Journal of Theoretical Probability, Vol. 25, Issue 3
Estimating cosmological parameter covariance
journal, June 2014
- Taylor, A.; Joachimi, B.
- Monthly Notices of the Royal Astronomical Society, Vol. 442, Issue 3
SAMPLE VARIANCE IN N -BODY SIMULATIONS AND IMPACT ON TOMOGRAPHIC SHEAR PREDICTIONS
journal, October 2015
- Casarini, Luciano; Piattella, Oliver F.; Bonometto, Silvio A.
- The Astrophysical Journal, Vol. 812, Issue 1
Joint analysis of cluster number counts and weak lensing power spectrum to correct for the super-sample covariance
journal, May 2014
- Takada, M.; Spergel, D. N.
- Monthly Notices of the Royal Astronomical Society, Vol. 441, Issue 3
Why your model parameter confidences might be too optimistic. Unbiased estimation of the inverse covariance matrix
journal, December 2006
- Hartlap, J.; Simon, P.; Schneider, P.
- Astronomy & Astrophysics, Vol. 464, Issue 1
The q Continuum Simulation: Harnessing the Power of gpu Accelerated Supercomputers
journal, August 2015
- Heitmann, Katrin; Frontiere, Nicholas; Sewell, Chris
- The Astrophysical Journal Supplement Series, Vol. 219, Issue 2
Works referencing / citing this record:
An improved cosmological parameter inference scheme motivated by deep learning
journal, October 2018
- Ribli, Dezső; Pataki, Bálint Ármin; Csabai, István
- Nature Astronomy, Vol. 3, Issue 1
Breaking degeneracies in modified gravity with higher (than 2nd) order weak-lensing statistics
journal, November 2018
- Peel, Austin; Pettorino, Valeria; Giocoli, Carlo
- Astronomy & Astrophysics, Vol. 619
Cosmic shear covariance matrix in w CDM: Cosmology matters
journal, November 2019
- Harnois-Déraps, J.; Giblin, B.; Joachimi, B.
- Astronomy & Astrophysics, Vol. 631
MassiveNuS: cosmological massive neutrino simulations
journal, March 2018
- Liu, Jia; Bird, Simeon; Matilla, José Manuel Zorrilla
- Journal of Cosmology and Astroparticle Physics, Vol. 2018, Issue 03
Constraining neutrino mass with the tomographic weak lensing bispectrum
journal, May 2019
- Coulton, William R.; Liu, Jia; Madhavacheril, Mathew S.
- Journal of Cosmology and Astroparticle Physics, Vol. 2019, Issue 05
The imprint of f(R) gravity on weak gravitational lensing – II. Information content in cosmic shear statistics
journal, December 2016
- Shirasaki, Masato; Nishimichi, Takahiro; Li, Baojiu
- Monthly Notices of the Royal Astronomical Society, Vol. 466, Issue 2
The effect of baryons in the cosmological lensing PDFs
journal, May 2018
- Castro, Tiago; Quartin, Miguel; Giocoli, Carlo
- Monthly Notices of the Royal Astronomical Society, Vol. 478, Issue 1
Cosmological simulations for combined-probe analyses: covariance and neighbour-exclusion bias
journal, August 2018
- Harnois-Déraps, J.; Amon, A.; Choi, A.
- Monthly Notices of the Royal Astronomical Society, Vol. 481, Issue 1
Weak lensing light-cones in modified gravity simulations with and without massive neutrinos
journal, September 2018
- Giocoli, Carlo; Baldi, Marco; Moscardini, Lauro
- Monthly Notices of the Royal Astronomical Society, Vol. 481, Issue 2
Weak lensing cosmology with convolutional neural networks on noisy data
journal, September 2019
- Ribli, Dezső; Pataki, Bálint Ármin; Zorrilla Matilla, José Manuel
- Monthly Notices of the Royal Astronomical Society, Vol. 490, Issue 2
Full-sky Gravitational Lensing Simulation for Large-area Galaxy Surveys and Cosmic Microwave Background Experiments
journal, November 2017
- Takahashi, Ryuichi; Hamana, Takashi; Shirasaki, Masato
- The Astrophysical Journal, Vol. 850, Issue 1
Full-sky Gravitational Lensing Simulation for Large-area Galaxy Surveys and Cosmic Microwave Background Experiments
text, January 2017
- Takahashi, Ryuichi; Hamana, Takashi; Shirasaki, Masato
- arXiv
The effect of baryons in the cosmological lensing PDFs
text, January 2017
- Castro, Tiago; Quartin, Miguel; Giocoli, Carlo
- arXiv
Cosmological Simulations for Combined-Probe Analyses: Covariance and Neighbour-Exclusion Bias
text, January 2018
- Harnois-Deraps, J.; Amon, A.; Choi, A.
- arXiv
Breaking degeneracies in modified gravity with higher (than 2nd) order weak-lensing statistics
text, January 2018
- Peel, Austin; Pettorino, Valeria; Giocoli, Carlo
- arXiv
On the effect of non-Gaussian lensing deflections on CMB lensing measurements
text, January 2018
- Böhm, Vanessa; Sherwin, Blake D.; Liu, Jia
- arXiv
Cosmological constraints from noisy convergence maps through deep learning
text, January 2018
- Fluri, Janis; Kacprzak, Tomasz; Lucchi, Aurelien
- arXiv
Weak lensing cosmology with convolutional neural networks on noisy data
text, January 2019
- Ribli, Dezső; Pataki, Bálint Ármin; Matilla, José Manuel Zorrilla
- arXiv