Title: Dark Energy Survey year 3 results: covariance modelling and its impact on parameter estimation and quality of fit

Journal Article · · Monthly Notices of the Royal Astronomical Society
 [1];  [2]; ORCiD logo [2];  [3];  [4];  [5]; ORCiD logo [6]; ORCiD logo [7];  [6];  [8];  [9];  [9];  [10];  [11];  [12];  [13];  [14];  [15];  [4];  [16] more »;  [17];  [18];  [19];  [20];  [21];  [22];  [17];  [23];  [24];  [25];  [9];  [26];  [5];  [20];  [18];  [27];  [28];  [29];  [25];  [30];  [30];  [31];  [22];  [24];  [32];  [18];  [18];  [33];  [9];  [9];  [34];  [18];  [35];  [36];  [37];  [36];  [20];  [18];  [18];  [37];  [38];  [39];  [12];  [5];  [40];  [41];  [42];  [43];  [44];  [28];  [36];  [30];  [45];  [46];  [12];  [37];  [47];  [48];  [49];  [50];  [41];  [25];  [51];  [52];  [46];  [5];  [53];  [29];  [11];  [54];  [55];  [28];  [56];  [46];  [22];  [57];  [17];  [50];  [58];  [59];  [37];  [5];  [25];  [12];  [60];  [61];  [12];  [42];  [31];  [62];  [62];  [44] « less
  1. Kavli Institute for Cosmology, University of Cambridge, Madingley Road, Cambridge CB3 0HA, UK, Churchill College, University of Cambridge, Cambridge CB3 0DS, UK
  2. Instituto de Física Teórica, Universidade Estadual Paulista, São Paulo, 01140-070, Brazil, Laboratório Interinstitucional de e-Astronomia – LIneA, Rua Gal. José Cristino 77, Rio de Janeiro, RJ 20921-400, Brazil
  3. Instituto de Física Teórica, Universidade Estadual Paulista, São Paulo, 01140-070, Brazil, Department of Physics, University of Michigan, Ann Arbor, MI 48109, USA
  4. Laboratório Interinstitucional de e-Astronomia – LIneA, Rua Gal. José Cristino 77, Rio de Janeiro, RJ 20921-400, Brazil, ICTP South American Institute for Fundamental Research Instituto de Física Teórica, Universidade Estadual Paulista, São Paulo, 01140-070, Brazil
  5. Fermi National Accelerator Laboratory, PO Box 500, Batavia, IL 60510, USA
  6. Department of Astronomy/Steward Observatory, University of Arizona, 933 North Cherry Avenue, Tucson, AZ 85721-0065, USA
  7. Department of Astronomy/Steward Observatory, University of Arizona, 933 North Cherry Avenue, Tucson, AZ 85721-0065, USA, Jet Propulsion Laboratory, California Institute of Technology, 4800 Oak Grove Drive, Pasadena, CA 91109, USA
  8. Department of Astronomy and Astrophysics, University of Chicago, Chicago, IL 60637, USA, Kavli Institute for Cosmological Physics, University of Chicago, Chicago, IL 60637, USA
  9. Kavli Institute for Particle Astrophysics and Cosmology, Stanford University, PO Box 2450, Stanford, CA 94305, USA
  10. Department of Physics and Astronomy, University of Hawaii, Watanabe 416, 2505 Correa Road, Honolulu, HI 96822, USA
  11. Center for Cosmology and Astro-Particle Physics, The Ohio State University, Columbus, OH 43210, USA, Department of Physics, The Ohio State University, Columbus, OH 43210, USA
  12. Department of Physics, University of Michigan, Ann Arbor, MI 48109, USA
  13. Center for Cosmology and Astro-Particle Physics, The Ohio State University, Columbus, OH 43210, USA, Institut d’Estudis Espacials de Catalunya (IEEC), E-08034 Barcelona, Spain, Institute of Space Sciences (ICE, CSIC), Campus UAB, Carrer de Can Magrans, s/n, E-08193 Barcelona, Spain
  14. Department of Astronomy and Astrophysics, University of Chicago, Chicago, IL 60637, USA
  15. Instituto de Física Teórica, Universidade Estadual Paulista, São Paulo, 01140-070, Brazil
  16. Argonne National Laboratory, 9700 South Cass Avenue, Lemont, IL 60439, USA
  17. Physics Department, 2320 Chamberlin Hall, University of Wisconsin-Madison, 1150 University Avenue, Madison, WI 53706-1390, USA
  18. Department of Physics and Astronomy, University of Pennsylvania, Philadelphia, PA 19104, USA
  19. SLAC National Accelerator Laboratory, Menlo Park, CA 94025, USA
  20. Department of Physics, Carnegie Mellon University, Pittsburgh, Pennsylvania 15312, USA
  21. Instituto de Astrofisica de Canarias, E-38205 La Laguna, Tenerife, Spain, Departamento Astrofísica, Universidad de La Laguna, E-38206 La Laguna, Tenerife, Spain
  22. Department of Astronomy, University of Illinois at Urbana–Champaign, 1002 West Green Street, Urbana, IL 61801, USA, National Center for Supercomputing Applications, 1205 West Clark Street, Urbana, IL 61801, USA
  23. Center for Cosmology and Astro-Particle Physics, The Ohio State University, Columbus, OH 43210, USA
  24. Jodrell Bank Center for Astrophysics, School of Physics and Astronomy, University of Manchester, Oxford Road, Manchester M13 9PL, UK
  25. Institut d’Estudis Espacials de Catalunya (IEEC), E-08034 Barcelona, Spain, Institute of Space Sciences (ICE, CSIC), Campus UAB, Carrer de Can Magrans, s/n, E-08193 Barcelona, Spain
  26. Department of Astronomy, University of California, Berkeley, 501 Campbell Hall, Berkeley, CA 94720, USA, Santa Cruz Institute for Particle Physics, Santa Cruz, CA 95064, USA
  27. Fermi National Accelerator Laboratory, PO Box 500, Batavia, IL 60510, USA, Department of Astronomy and Astrophysics, University of Chicago, Chicago, IL 60637, USA, Kavli Institute for Cosmological Physics, University of Chicago, Chicago, IL 60637, USA
  28. Department of Physics & Astronomy, University College London, Gower Street, London WC1E 6BT, UK
  29. Santa Cruz Institute for Particle Physics, Santa Cruz, CA 95064, USA
  30. Institut de Física d’Altes Energies (IFAE), The Barcelona Institute of Science and Technology, Campus UAB, E-08193 Bellaterra (Barcelona), Spain
  31. Kavli Institute for Particle Astrophysics and Cosmology, Stanford University, PO Box 2450, Stanford, CA 94305, USA, SLAC National Accelerator Laboratory, Menlo Park, CA 94025, USA, Department of Physics, Stanford University, 382 Via Pueblo Mall, Stanford, CA 94305, USA
  32. Département de Physique Théorique and Center for Astroparticle Physics, Université de Genève, 24 Quai Ernest Ansermet, CH-1211 Geneva, Switzerland
  33. Department of Applied Mathematics and Theoretical Physics, University of Cambridge, Cambridge CB3 0WA, UK
  34. Department of Physics, Stanford University, 382 Via Pueblo Mall, Stanford, CA 94305, USA
  35. Kavli Institute for Cosmological Physics, University of Chicago, Chicago, IL 60637, USA
  36. Kavli Institute for Particle Astrophysics and Cosmology, Stanford University, PO Box 2450, Stanford, CA 94305, USA, SLAC National Accelerator Laboratory, Menlo Park, CA 94025, USA
  37. Centro de Investigaciones Energéticas, Medioambientales y Tecnológicas (CIEMAT), Madrid, 28040, Spain
  38. Brookhaven National Laboratory, Bldg 510, Upton, NY 11973, USA
  39. Department of Physics, Duke University Durham, Durham, NC 27708, USA
  40. Laboratório Interinstitucional de e-Astronomia – LIneA, Rua Gal. José Cristino 77, Rio de Janeiro, RJ 20921-400, Brazil, Departamento de Física Matemática, Instituto de Física, Universidade de São Paulo, CP 66318, São Paulo, SP 05314-970, Brazil
  41. Instituto de Fisica Teorica UAM/CSIC, Universidad Autonoma de Madrid, E-28049 Madrid, Spain
  42. Institute of Cosmology and Gravitation, University of Portsmouth, Portsmouth PO1 3FX, UK
  43. CNRS, UMR 7095, Institut d’Astrophysique de Paris, F-75014 Paris, France, Sorbonne Universités, UPMC Univ Paris 06, UMR 7095, Institut d’Astrophysique de Paris, F-75014 Paris, France
  44. Department of Physics and Astronomy, Pevensey Building, University of Sussex, Brighton BN1 9QH, UK
  45. INAF – Osservatorio Astronomico di Trieste, Via G. B. Tiepolo 11, I-34143 Trieste, Italy, Institute for Fundamental Physics of the Universe, Via Beirut 2, I-34014 Trieste, Italy
  46. Laboratório Interinstitucional de e-Astronomia – LIneA, Rua Gal. José Cristino 77, Rio de Janeiro, RJ 20921-400, Brazil, Observatório Nacional, Rua Gal. José Cristino 77, Rio de Janeiro, RJ 20921-400, Brazil
  47. Department of Physics, IIT Hyderabad, Kandi, Telangana 502285, India
  48. Laboratório Interinstitucional de e-Astronomia – LIneA, Rua Gal. José Cristino 77, Rio de Janeiro, RJ 20921-400, Brazil, Department of Astronomy, University of Michigan, Ann Arbor, MI 48109, USA
  49. Institute of Theoretical Astrophysics, University of Oslo, PO Box 1029 Blindern, NO-0315 Oslo, Norway
  50. Fermi National Accelerator Laboratory, PO Box 500, Batavia, IL 60510, USA, Kavli Institute for Cosmological Physics, University of Chicago, Chicago, IL 60637, USA
  51. Department of Physics, University of Michigan, Ann Arbor, MI 48109, USA, Department of Astronomy, University of Michigan, Ann Arbor, MI 48109, USA
  52. Kavli Institute for Cosmology, University of Cambridge, Madingley Road, Cambridge CB3 0HA, UK, Institute of Astronomy, University of Cambridge, Madingley Road, Cambridge CB3 0HA, UK
  53. School of Mathematics and Physics, University of Queensland, Brisbane, QLD 4072, Australia
  54. Center for Astrophysics | Harvard & Smithsonian, 60 Garden Street, Cambridge, MA 02138, USA
  55. Australian Astronomical Optics, Macquarie University, North Ryde, NSW 2113, Australia, Lowell Observatory, 1400 Mars Hill Road, Flagstaff, AZ 86001, USA
  56. Instituto de Física Teórica, Universidade Estadual Paulista, São Paulo, 01140-070, Brazil, Departamento de Física Matemática, Instituto de Física, Universidade de São Paulo, CP 66318, São Paulo, SP 05314-970, Brazil
  57. Institut de Física d’Altes Energies (IFAE), The Barcelona Institute of Science and Technology, Campus UAB, E-08193 Bellaterra (Barcelona), Spain, Institució Catalana de Recerca i Estudis Avançats, E-08010 Barcelona, Spain
  58. National Center for Supercomputing Applications, 1205 West Clark Street, Urbana, IL 61801, USA, Institute of Astronomy, University of Cambridge, Madingley Road, Cambridge CB3 0HA, UK
  59. Department of Astrophysical Sciences, Princeton University, Peyton Hall, Princeton, NJ 08544, USA
  60. School of Physics and Astronomy, University of Southampton, Southampton SO17 1BJ, UK
  61. Computer Science and Mathematics Division, Oak Ridge National Laboratory, Oak Ridge, TN 37831, USA
  62. Max Planck Institute for Extraterrestrial Physics, Giessenbachstrasse, D-85748 Garching, Germany, Universitäts-Sternwarte, Fakultät für Physik, Ludwig-Maximilians Universität München, Scheinerstr 1, D-81679 München, Germany
+ Show Author Affiliations

ABSTRACT We describe and test the fiducial covariance matrix model for the combined two-point function analysis of the Dark Energy Survey Year 3 (DES-Y3) data set. Using a variety of new ansatzes for covariance modelling and testing, we validate the assumptions and approximations of this model. These include the assumption of Gaussian likelihood, the trispectrum contribution to the covariance, the impact of evaluating the model at a wrong set of parameters, the impact of masking and survey geometry, deviations from Poissonian shot noise, galaxy weighting schemes, and other sub-dominant effects. We find that our covariance model is robust and that its approximations have little impact on goodness of fit and parameter estimation. The largest impact on best-fitting figure-of-merit arises from the so-called fsky approximation for dealing with finite survey area, which on average increases the χ2 between maximum posterior model and measurement by $$3.7{{\ \rm per\ cent}}$$ (Δχ2 ≈ 18.9). Standard methods to go beyond this approximation fail for DES-Y3, but we derive an approximate scheme to deal with these features. For parameter estimation, our ignorance of the exact parameters at which to evaluate our covariance model causes the dominant effect. We find that it increases the scatter of maximum posterior values for Ωm and σ8 by about $$3{{\ \rm per\ cent}}$$ and for the dark energy equation-of-state parameter by about $$5{{\ \rm per\ cent}}$$.

Research Organization:
Argonne National Laboratory (ANL), Argonne, IL (United States); Arizona U., Astron. Dept. - Steward Observ.; Barcelona, IEEC; Barcelona, IFAE; Brookhaven National Laboratory (BNL), Upton, NY (United States); Caltech, JPL; Cambridge U.; Cambridge U., DAMTP; Cambridge U., Inst. of Astron.; Cambridge U., KICC; Carnegie Mellon U.; Chicago U., Astron. Astrophys. Ctr.; Chicago U., KICP; Duke U.; Fermi National Accelerator Laboratory (FNAL), Batavia, IL (United States); Garching, Max Planck Inst., MPE; Geneva U., Dept. Theor. Phys.; Harvard-Smithsonian Ctr. Astrophys.; IAC, La Laguna; ICE, Bellaterra; ICREA, Barcelona; ICTP-SAIFR, Sao Paulo; Illinois U., Urbana, Astron. Dept.; Indian Inst. Tech., Hyderabad; Inst. Astron., Honolulu; Inst. Theor. Astrophys., Oslo; Jodrell Bank; LIneA, Rio de Janeiro; Laguna U., Tenerife; Lowell Observ.; Macquarie U.; Madrid, CIEMAT; Madrid, IFT; Michigan U.; Munich U.; NCSA, Urbana; Oak Ridge National Laboratory (ORNL), Oak Ridge, TN (United States); Ohio State U.; Ohio State U., CCAPP; Paris, Inst. Astrophys.; Pennsylvania U.; Portsmouth U., ICG; Princeton U., Astrophys. Sci. Dept.; Queensland U.; Rio de Janeiro Observ.; SLAC National Accelerator Laboratory (SLAC), Menlo Park, CA (United States); Sao Paulo U.; Sao Paulo, IFT; Southampton U.; Stanford U., Phys. Dept.; Sussex U.; Trieste Observ.; Trieste U.; UC, Berkeley, Astron. Dept.; UC, Santa Cruz, Inst. Part. Phys.; Univ. of Michigan, Ann Arbor, MI (United States); University Coll. London; Wisconsin U., Madison
Sponsoring Organization:
US Department of Energy; USDOE; USDOE Office of Science (SC), High Energy Physics (HEP)
Contributing Organization:
DES Collaboration
Grant/Contract Number:
AC02-07CH11359; AC05-00OR22725; SC0019193
OSTI ID:
1826647
Report Number(s):
DES-2019-0466; FERMILAB-PUB-20-663-E-SCD-V
Journal Information:
Monthly Notices of the Royal Astronomical Society, Journal Name: Monthly Notices of the Royal Astronomical Society Journal Issue: 3 Vol. 508; ISSN 0035-8711
Publisher:
Oxford University PressCopyright Statement
Country of Publication:
United Kingdom
Language:
English

References (90)

Effective sample size for importance sampling based on discrepancy measures journal February 2017
Coming of age of the standard model journal February 2020
Array programming with NumPy journal September 2020
Stable clustering, the halo model and non-linear cosmological power spectra journal June 2003
Dependence of cosmic shear covariances on cosmology: Impact on parameter estimation journal June 2009
Constrained correlation functions journal July 2009
Cosmic shear covariance: the log-normal approximation journal December 2011
On the assumption of Gaussianity for cosmological two-point statistics and parameter dependent covariance matrices journal February 2013
Planck 2018 results: VI. Cosmological parameters journal September 2020
Analysis of two-point statistics of cosmic shear: I. Estimators and covariances journal November 2002
Analysis of two-point statistics of cosmic shear: II. Optimizing the survey geometry journal December 2003
Why your model parameter confidences might be too optimistic. Unbiased estimation of the inverse covariance matrix journal December 2006
The Analysis of Counts of the Extragalactic Nebulae in Terms of a Fluctuating Density Field. journal January 1953
Bias and variance of angular correlation functions journal July 1993
HEALPix: A Framework for High‐Resolution Discretization and Fast Analysis of Data Distributed on the Sphere journal April 2005
Simulations of Wide-Field weak Lensing Surveys. i. Basic Statistics and Non-Gaussian Effects journal July 2009
Simulations of Wide-Field Weak-Lensing Surveys. ii. Covariance Matrix of Real-Space Correlation Functions journal May 2011
Revising the Halofit Model for the Nonlinear Matter Power Spectrum journal December 2012
Including parameter dependence in the data and covariance for cosmological inference journal December 2015
Accurate cosmic shear errors: do we need ensembles of simulations? journal October 2018
Big-Bang Nucleosynthesis after Planck journal March 2020
Tomographic galaxy clustering with the Subaru Hyper Suprime-Cam first year public data release journal March 2020
Beyond Limber: efficient computation of angular power spectra for galaxy clustering and weak lensing journal May 2020
Clustering in real space and in redshift space journal July 1987
A lognormal model for the cosmological mass distribution journal January 1991
2D-FFTLog: efficient computation of real-space covariance matrices for galaxy clustering and weak lensing journal June 2020
Non-Gaussianity in the weak lensing correlation function likelihood – implications for cosmological parameter biases journal October 2020
First cosmology results using type Ia supernovae from the Dark Energy Survey: the effect of host galaxy properties on supernova luminosity journal April 2020
Blinding multiprobe cosmological experiments journal April 2020
Putting the precision in precision cosmology: How accurate should your data covariance matrix be? journal May 2013
The clustering of Galaxies in the SDSS-III Baryon Oscillation Spectroscopic Survey: including covariance matrix errors journal February 2014
Cosmology and astrophysics from relaxed galaxy clusters – II. Cosmological constraints journal April 2014
Estimating cosmological parameter covariance journal June 2014
Cosmological parameter inference from galaxy clustering: the effect of the posterior distribution of the power spectrum journal November 2015
The impact of intrinsic alignment on current and future cosmic shear surveys journal December 2015
Performance of internal covariance estimators for cosmic shear correlation functions journal December 2015
Testing the lognormality of the galaxy and weak lensing convergence distributions from Dark Energy Survey maps journal August 2016
Quantifying lost information due to covariance matrix estimation in parameter inference journal October 2016
Improving lognormal models for cosmological fields journal April 2016
cosmolike – cosmological likelihood analyses for photometric galaxy surveys journal May 2017
Precision matrix expansion – efficient use of numerical simulations in estimating errors on cosmological parameters journal October 2017
Dark Energy Survey Year-1 results: galaxy mock catalogues for BAO journal May 2018
Unveiling galaxy bias via the halo model, KiDS, and GAMA journal June 2018
Survey geometry and the internal consistency of recent cosmic shear measurements journal June 2018
DES Y1 Results: validating cosmological parameter estimation using simulated Dark Energy Surveys journal July 2018
A Bayesian method for combining theoretical and simulated covariance matrices for large-scale structure surveys journal November 2018
The skewed weak lensing likelihood: why biases arise, despite data and theory being sound journal April 2018
A unified pseudo- C ℓ framework journal January 2019
Methods for cluster cosmology and application to the SDSS in preparation for DES Year 1 release journal July 2019
Phenotypic redshifts with self-organizing maps: A novel method to characterize redshift distributions of source galaxies for weak lensing journal August 2019
Estimating covariance matrices for two- and three-point correlation function moments in Arbitrary Survey Geometries journal October 2019
rascalc : a jackknife approach to estimating single- and multitracer galaxy covariance matrices journal November 2019
Mock galaxy shape catalogues in the Subaru Hyper Suprime-Cam Survey journal March 2019
Non-linear shrinkage estimation of large-scale structure covariance journal November 2016
Dark Energy Survey Year 1 Results: Cosmological constraints from cluster abundances and weak lensing journal July 2020
Likelihood analysis of CMB temperature and polarization power spectra journal May 2008
Extended Limber approximation journal December 2008
Power spectrum super-sample covariance journal June 2013
The effect of covariance estimator error on cosmological parameter constraints journal September 2013
Halo stochasticity from exclusion and nonlinear clustering journal October 2013
Information gains from cosmic microwave background experiments journal July 2014
Joint likelihood function of cluster counts and n -point correlation functions: Improving their power through including halo sample variance journal December 2014
Quantifying concordance in cosmology journal May 2016
Density split statistics: Cosmological constraints from counts and lensing in cells in DES Y1 and SDSS data journal July 2018
Density split statistics: Joint model of counts and lensing in cells journal July 2018
Dark Energy Survey year 1 results: Galaxy clustering for combined probes journal August 2018
Dark Energy Survey year 1 results: Cosmological constraints from galaxy clustering and weak lensing journal August 2018
Dark Energy Survey Year 1 results: Cosmological constraints from cosmic shear journal August 2018
Concordance and discordance in cosmology journal February 2019
Dark Energy Survey year 1 results: Constraints on extended cosmological models from galaxy clustering and weak lensing journal June 2019
Cosmological Constraints from Multiple Probes in the Dark Energy Survey journal May 2019
Matplotlib: A 2D Graphics Environment journal January 2007
Myths and truths concerning estimation of power spectra: the case for a hybrid estimator journal April 2004
The skewness of the aperture mass statistic journal July 2004
The 2dF Galaxy Redshift Survey: stochastic relative biasing between galaxy populations journal January 2005
Error analysis of quadratic power spectrum estimates for cosmic microwave background polarization: sampling covariance journal June 2005
Multimodal nested sampling: an efficient and robust alternative to Markov Chain Monte Carlo methods for astronomical data analyses: Multimodal nested sampling journal January 2008
Shrinkage estimation of the power spectrum covariance matrix journal September 2008
Clustering of luminous red galaxies - I. Large-scale redshift-space distortions journal March 2009
Statistical analysis of galaxy surveys - I. Robust error estimation for two-point clustering statistics journal June 2009
MultiNest: an efficient and robust Bayesian inference tool for cosmology and particle physics journal October 2009
Modelling the angular correlation function and its full covariance in photometric galaxy surveys: Angular clustering in photometric surveys journal March 2011
Measuring redshift-space distortions using photometric surveys: RSD with photometric data journal May 2011
Quantum Theory of Angular Momentum book October 1988
Seeing Cosmology Grow journal September 2012
Dark Energy and the Accelerating Universe journal September 2008
Importance Nested Sampling and the MultiNest Algorithm journal November 2019
ChainConsumer journal August 2016
The Dark Energy Survey and Operations: Year 6 – The Finale report January 2020
Practical Weak-lensing Shear Measurement with Metacalibration journal May 2017

Similar Records

Dark Energy Survey Year 3 results: cosmology with moments of weak lensing mass maps – validation on simulations
Journal Article · 2020 · Monthly Notices of the Royal Astronomical Society · OSTI ID:1668095
+68 more
An empirical approach to model selection: weak lensing and intrinsic alignments
Journal Article · 2023 · Monthly Notices of the Royal Astronomical Society · OSTI ID:1996443
Cosmic shear cosmology beyond two-point statistics: a combined peak count and correlation function analysis of DES-Y1
Journal Article · 2021 · Monthly Notices of the Royal Astronomical Society · OSTI ID:1808217
+5 more

Related Subjects

79 ASTRONOMY AND ASTROPHYSICS
cosmology
cosmology: observations
large-scale structure of Universe