Estimating covariance matrices for two- and three-point correlation function moments in Arbitrary Survey Geometries
Abstract
ABSTRACT We present configuration-space estimators for the auto- and cross-covariance of two- and three-point correlation functions (2PCF and 3PCF) in general survey geometries. These are derived in the Gaussian limit (setting higher order correlation functions to zero), but for arbitrary non-linear 2PCFs (which may be estimated from the survey itself), with a shot-noise rescaling parameter included to capture non-Gaussianity. We generalize previous approaches to include Legendre moments via a geometry-correction function calibrated from measured pair and triple counts. Making use of importance sampling and random particle catalogues, we can estimate model covariances in fractions of the time required to do so with mocks, obtaining estimates with negligible sampling noise in ∼10 (∼100) CPU-hours for the 2PCF (3PCF) autocovariance. We compare results to sample covariances from a suite of BOSS DR12 mocks and find the matrices to be in good agreement, assuming a shot-noise rescaling parameter of 1.03 (1.20) for the 2PCF (3PCF). To obtain strongest constraints on cosmological parameters, we must use multiple statistics in concert; having robust methods to measure their covariances at low computational cost is thus of great relevance to upcoming surveys.
- Authors:
-
- Center for Astrophysics | Harvard & Smithsonian, 60 Garden St., Cambridge, MA 02138, USA, Department of Astrophysical Sciences, Princeton University, Princeton, NJ 08544, USA
- Center for Astrophysics | Harvard & Smithsonian, 60 Garden St., Cambridge, MA 02138, USA
- Publication Date:
- Research Org.:
- Harvard Univ., Cambridge, MA (United States)
- Sponsoring Org.:
- USDOE Office of Science (SC)
- OSTI Identifier:
- 1574553
- Alternate Identifier(s):
- OSTI ID: 1802523
- Grant/Contract Number:
- SC0013718
- Resource Type:
- Published Article
- Journal Name:
- Monthly Notices of the Royal Astronomical Society
- Additional Journal Information:
- Journal Name: Monthly Notices of the Royal Astronomical Society Journal Volume: 490 Journal Issue: 4; Journal ID: ISSN 0035-8711
- Publisher:
- Oxford University Press
- Country of Publication:
- United Kingdom
- Language:
- English
- Subject:
- 79 ASTRONOMY AND ASTROPHYSICS; Astronomy & Astrophysics
Citation Formats
Philcox, Oliver H. E., and Eisenstein, Daniel J. Estimating covariance matrices for two- and three-point correlation function moments in Arbitrary Survey Geometries. United Kingdom: N. p., 2019.
Web. doi:10.1093/mnras/stz2896.
Philcox, Oliver H. E., & Eisenstein, Daniel J. Estimating covariance matrices for two- and three-point correlation function moments in Arbitrary Survey Geometries. United Kingdom. https://doi.org/10.1093/mnras/stz2896
Philcox, Oliver H. E., and Eisenstein, Daniel J. Wed .
"Estimating covariance matrices for two- and three-point correlation function moments in Arbitrary Survey Geometries". United Kingdom. https://doi.org/10.1093/mnras/stz2896.
@article{osti_1574553,
title = {Estimating covariance matrices for two- and three-point correlation function moments in Arbitrary Survey Geometries},
author = {Philcox, Oliver H. E. and Eisenstein, Daniel J.},
abstractNote = {ABSTRACT We present configuration-space estimators for the auto- and cross-covariance of two- and three-point correlation functions (2PCF and 3PCF) in general survey geometries. These are derived in the Gaussian limit (setting higher order correlation functions to zero), but for arbitrary non-linear 2PCFs (which may be estimated from the survey itself), with a shot-noise rescaling parameter included to capture non-Gaussianity. We generalize previous approaches to include Legendre moments via a geometry-correction function calibrated from measured pair and triple counts. Making use of importance sampling and random particle catalogues, we can estimate model covariances in fractions of the time required to do so with mocks, obtaining estimates with negligible sampling noise in ∼10 (∼100) CPU-hours for the 2PCF (3PCF) autocovariance. We compare results to sample covariances from a suite of BOSS DR12 mocks and find the matrices to be in good agreement, assuming a shot-noise rescaling parameter of 1.03 (1.20) for the 2PCF (3PCF). To obtain strongest constraints on cosmological parameters, we must use multiple statistics in concert; having robust methods to measure their covariances at low computational cost is thus of great relevance to upcoming surveys.},
doi = {10.1093/mnras/stz2896},
journal = {Monthly Notices of the Royal Astronomical Society},
number = 4,
volume = 490,
place = {United Kingdom},
year = {Wed Oct 16 00:00:00 EDT 2019},
month = {Wed Oct 16 00:00:00 EDT 2019}
}
https://doi.org/10.1093/mnras/stz2896
Web of Science
Works referenced in this record:
The Baryon Oscillation Spectroscopic Survey of Sdss-Iii
journal, December 2012
- Dawson, Kyle S.; Schlegel, David J.; Ahn, Christopher P.
- The Astronomical Journal, Vol. 145, Issue 1
Computing the three-point correlation function of galaxies in $\mathcal {O}(N^2)$ time
journal, October 2015
- Slepian, Zachary; Eisenstein, Daniel J.
- Monthly Notices of the Royal Astronomical Society, Vol. 454, Issue 4
The three-point correlation function in cosmology
journal, April 2003
- Takada, Masahiro; Jain, Bhuvnesh
- Monthly Notices of the Royal Astronomical Society, Vol. 340, Issue 2
Constraining the baryon–dark matter relative velocity with the large-scale three-point correlation function of the SDSS BOSS DR12 CMASS galaxies
journal, October 2017
- Slepian, Zachary; Eisenstein, Daniel J.; Blazek, Jonathan A.
- Monthly Notices of the Royal Astronomical Society, Vol. 474, Issue 2
Mock galaxy catalogues using the quick particle mesh method
journal, November 2013
- White, Martin; Tinker, Jeremy L.; McBride, Cameron K.
- Monthly Notices of the Royal Astronomical Society, Vol. 437, Issue 3
Statistical analysis of catalogs of extragalactic objects. VII - Two- and three-point correlation functions for the high-resolution Shane-Wirtanen catalog of galaxies
journal, October 1977
- Groth, E. J.; Peebles, P. J. E.
- The Astrophysical Journal, Vol. 217
A Critique of Rees's Theory of Primordial Gravitational Radiation
journal, February 1972
- Jackson, J. C.
- Monthly Notices of the Royal Astronomical Society, Vol. 156, Issue 1
Primordial non-Gaussianity from the large-scale structure
journal, May 2010
- Desjacques, V.; Seljak, U.
- Classical and Quantum Gravity, Vol. 27, Issue 12
Three-Point Correlation Functions of SDSS Galaxies in Redshift Space: Morphology, Color, and Luminosity Dependence
journal, June 2004
- Kayo, Issha; Suto, Yasushi; Nichol, Robert C.
- Publications of the Astronomical Society of Japan, Vol. 56, Issue 3
A New Class of Estimators for the [ITAL]N[/ITAL]-Point Correlations
journal, February 1998
- Szapudi, István; Szalay, Alexander S.
- The Astrophysical Journal, Vol. 494, Issue 1
The Generalised Product Moment Distribution in Samples from a Normal Multivariate Population
journal, January 1928
- Wishart, John
- Biometrika, Vol. 20A, Issue 1-2
Modelling the redshift-space three-point correlation function in SDSS-III
journal, March 2015
- Guo, Hong; Zheng, Zheng; Jing, Y. P.
- Monthly Notices of the Royal Astronomical Society: Letters, Vol. 449, Issue 1
The clustering of galaxies in the completed SDSS-III Baryon Oscillation Spectroscopic Survey: theoretical systematics and Baryon Acoustic Oscillations in the galaxy correlation function
journal, March 2018
- Vargas-Magaña, Mariana; Ho, Shirley; Cuesta, Antonio J.
- Monthly Notices of the Royal Astronomical Society, Vol. 477, Issue 1
Improving measurements of H(z) and DA (z) by analysing clustering anisotropies: Improving H(z) and DA(z) measurements
journal, November 2011
- Kazin, Eyal A.; Sánchez, Ariel G.; Blanton, Michael R.
- Monthly Notices of the Royal Astronomical Society, Vol. 419, Issue 4
The clustering of galaxies in the completed SDSS-III Baryon Oscillation Spectroscopic Survey: Cosmological implications of the configuration-space clustering wedges
journal, September 2016
- Sánchez, Ariel G.; Scoccimarro, Román; Crocce, Martín
- Monthly Notices of the Royal Astronomical Society, Vol. 464, Issue 2
The Eleventh and Twelfth data Releases of the Sloan Digital sky Survey: Final data from Sdss-Iii
journal, July 2015
- Alam, Shadab; Albareti, Franco D.; Prieto, Carlos Allende
- The Astrophysical Journal Supplement Series, Vol. 219, Issue 1
Exploring the squeezed three-point galaxy correlation function with generalized halo occupation distribution models
journal, April 2018
- Yuan, Sihan; Eisenstein, Daniel J.; Garrison, Lehman H.
- Monthly Notices of the Royal Astronomical Society, Vol. 478, Issue 2
Detection of baryon acoustic oscillation features in the large-scale three-point correlation function of SDSS BOSS DR12 CMASS galaxies
journal, March 2017
- Slepian, Zachary; Eisenstein, Daniel J.; Brownstein, Joel R.
- Monthly Notices of the Royal Astronomical Society, Vol. 469, Issue 2
The clustering of galaxies in the completed SDSS-III Baryon Oscillation Spectroscopic Survey: on the measurement of growth rate using galaxy correlation functions
journal, April 2017
- Satpathy, Siddharth; Alam, Shadab; Ho, Shirley
- Monthly Notices of the Royal Astronomical Society, Vol. 469, Issue 2
Modeling the Galaxy Three‐Point Correlation Function
journal, January 2008
- Marin, Felipe A.; Wechsler, Risa H.; Frieman, Joshua A.
- The Astrophysical Journal, Vol. 672, Issue 2
The clustering of galaxies in the completed SDSS-III Baryon Oscillation Spectroscopic Survey: cosmological analysis of the DR12 galaxy sample
journal, March 2017
- Alam, Shadab; Ata, Metin; Bailey, Stephen
- Monthly Notices of the Royal Astronomical Society, Vol. 470, Issue 3
A measurement of the cosmological mass density from clustering in the 2dF Galaxy Redshift Survey
journal, March 2001
- Peacock, John A.; Cole, Shaun; Norberg, Peder
- Nature, Vol. 410, Issue 6825
Statistical analysis of catalogs of extragalactic objects. V - Three-point correlation function for the galaxy distribution in the Zwicky catalog
journal, February 1975
- Peebles, P. J. E.; Groth, E. J.
- The Astrophysical Journal, Vol. 196
Power-spectrum analysis of three-dimensional redshift surveys
journal, May 1994
- Feldman, Hume A.; Kaiser, Nick; Peacock, John A.
- The Astrophysical Journal, Vol. 426
Large-scale structure of the Universe and cosmological perturbation theory
journal, September 2002
- Bernardeau, F.; Colombi, S.; Gaztañaga, E.
- Physics Reports, Vol. 367, Issue 1-3
Planck 2015 results : XIII. Cosmological parameters
journal, September 2016
- Ade, P. A. R.; Aghanim, N.; Arnaud, M.
- Astronomy & Astrophysics, Vol. 594
Using galaxy pairs to investigate the three-point correlation function in the squeezed limit
journal, August 2017
- Yuan, Sihan; Eisenstein, Daniel J.; Garrison, Lehman H.
- Monthly Notices of the Royal Astronomical Society, Vol. 472, Issue 1
Assessment of the information content of the power spectrum and bispectrum
journal, July 2017
- Chan, Kwan Chuen; Blot, Linda
- Physical Review D, Vol. 96, Issue 2
Power Spectrum Correlations Induced by Nonlinear Clustering
journal, December 1999
- Scoccimarro, Roman; Zaldarriaga, Matias; Hui, Lam
- The Astrophysical Journal, Vol. 527, Issue 1
The Large-Scale Three-Point Correlation Function of Sloan Digital sky Survey Luminous red Galaxies
journal, August 2011
- Marín, Felipe
- The Astrophysical Journal, Vol. 737, Issue 2
Large covariance matrices: smooth models from the two-point correlation function
journal, July 2016
- O'Connell, Ross; Eisenstein, Daniel; Vargas, Mariana
- Monthly Notices of the Royal Astronomical Society, Vol. 462, Issue 3
Cosmology and the bispectrum
journal, July 2006
- Sefusatti, Emiliano; Crocce, Martín; Pueblas, Sebastián
- Physical Review D, Vol. 74, Issue 2
Modelling the large-scale redshift-space 3-point correlation function of galaxies
journal, March 2017
- Slepian, Zachary; Eisenstein, Daniel J.
- Monthly Notices of the Royal Astronomical Society, Vol. 469, Issue 2
On a Formula for the Product-Moment Coefficient of any Order of a Normal Frequency Distribution in any Number of Variables
journal, November 1918
- Isserlis, L.
- Biometrika, Vol. 12, Issue 1-2
Three-Point Statistics from a New Perspective
journal, March 2004
- Szapudi, Istvn
- The Astrophysical Journal, Vol. 605, Issue 2
The three-point function as a probe of models for large-scale structure
journal, April 1994
- Frieman, Joshua A.; Gaztanaga, Enrique
- The Astrophysical Journal, Vol. 425
Sdss-Iii: Massive Spectroscopic Surveys of the Distant Universe, the Milky way, and Extra-Solar Planetary Systems
journal, August 2011
- Eisenstein, Daniel J.; Weinberg, David H.; Agol, Eric
- The Astronomical Journal, Vol. 142, Issue 3
The clustering of the SDSS-IV extended Baryon Oscillation Spectroscopic Survey DR14 quasar sample: measurement of the growth rate of structure from the anisotropic correlation function between redshift 0.8 and 2.2
journal, February 2018
- Zarrouk, Pauline; Burtin, Etienne; Gil-Marín, Héctor
- Monthly Notices of the Royal Astronomical Society, Vol. 477, Issue 2
An evolution free test for non-zero cosmological constant
journal, October 1979
- Alcock, Charles; Paczyński, Bohdan
- Nature, Vol. 281, Issue 5730
A practical computational method for the anisotropic redshift-space three-point correlation function
journal, April 2018
- Slepian, Zachary; Eisenstein, Daniel J.
- Monthly Notices of the Royal Astronomical Society, Vol. 478, Issue 2
A complete FFT-based decomposition formalism for the redshift-space bispectrum
journal, November 2018
- Sugiyama, Naonori S.; Saito, Shun; Beutler, Florian
- Monthly Notices of the Royal Astronomical Society, Vol. 484, Issue 1
The effect of large-scale structure on the SDSS galaxy three-point correlation function
journal, June 2006
- Nichol, R. C.; Sheth, R. K.; Suto, Y.
- Monthly Notices of the Royal Astronomical Society, Vol. 368, Issue 4
On Information and Sufficiency
journal, March 1951
- Kullback, S.; Leibler, R. A.
- The Annals of Mathematical Statistics, Vol. 22, Issue 1
The clustering of Galaxies in the SDSS-III Baryon Oscillation Spectroscopic Survey: including covariance matrix errors
journal, February 2014
- Percival, Will J.; Ross, Ashley J.; Sánchez, Ariel G.
- Monthly Notices of the Royal Astronomical Society, Vol. 439, Issue 3
Constraining the halo bispectrum in real and redshift space from perturbation theory and non-linear stochastic bias
journal, April 2015
- Kitaura, F. -S.; Gil-Marin, H.; Scoccola, C. G.
- Monthly Notices of the Royal Astronomical Society, Vol. 450, Issue 2
Large covariance matrices: accurate models without mocks
journal, May 2019
- O’Connell, Ross; Eisenstein, Daniel J.
- Monthly Notices of the Royal Astronomical Society, Vol. 487, Issue 2
The Three‐Point Correlation Function of Galaxies Determined from the Two‐Degree Field Galaxy Redshift Survey
journal, May 2004
- Jing, Y. P.; Borner, G.
- The Astrophysical Journal, Vol. 607, Issue 1
Bias and variance of angular correlation functions
journal, July 1993
- Landy, Stephen D.; Szalay, Alexander S.
- The Astrophysical Journal, Vol. 412
On the signature of the baryon–dark matter relative velocity in the two- and three-point galaxy correlation functions
journal, February 2015
- Slepian, Zachary; Eisenstein, Daniel J.
- Monthly Notices of the Royal Astronomical Society, Vol. 448, Issue 1
Clustering in real space and in redshift space
journal, July 1987
- Kaiser, Nick
- Monthly Notices of the Royal Astronomical Society, Vol. 227, Issue 1
The variance of correlation function estimates
journal, March 1994
- Bernstein, Gary M.
- The Astrophysical Journal, Vol. 424
Bias and high-order galaxy correlation functions in the APM galaxy survey
journal, December 1994
- Gaztanaga, Enrique; Frieman, Joshua A.
- The Astrophysical Journal, Vol. 437
Why your model parameter confidences might be too optimistic. Unbiased estimation of the inverse covariance matrix
journal, December 2006
- Hartlap, J.; Simon, P.; Schneider, P.
- Astronomy & Astrophysics, Vol. 464, Issue 1
A new Statistic for Analyzing Baryon Acoustic Oscillations
journal, July 2010
- Xu, X.; White, M.; Padmanabhan, N.
- The Astrophysical Journal, Vol. 718, Issue 2
Modelling baryon acoustic oscillations with perturbation theory and stochastic halo biasing
journal, December 2013
- Kitaura, Francisco-Shu; Yepes, Gustavo; Prada, Francisco
- Monthly Notices of the Royal Astronomical Society: Letters, Vol. 439, Issue 1
Fast n-point correlation functions and three-point lensing application
journal, July 2005
- Zhang, Lucy Liuxuan; Pen, Ue-Li
- New Astronomy, Vol. 10, Issue 7
Detection of the Baryon Acoustic Peak in the Large‐Scale Correlation Function of SDSS Luminous Red Galaxies
journal, November 2005
- Eisenstein, Daniel J.; Zehavi, Idit; Hogg, David W.
- The Astrophysical Journal, Vol. 633, Issue 2
Putting the precision in precision cosmology: How accurate should your data covariance matrix be?
journal, May 2013
- Taylor, A.; Joachimi, B.; Kitching, T.
- Monthly Notices of the Royal Astronomical Society, Vol. 432, Issue 3