No Galaxy Left Behind: Accurate Measurements with the Faintest Objects in the Dark Energy Survey
Abstract
Accurate statistical measurement with large imaging surveys has traditionally required throwing away a sizable fraction of the data. This is because most measurements have relied on selecting nearly complete samples, where variations in the composition of the galaxy population with seeing, depth, or other survey characteristics are small. Here, we introduce a new measurement method that aims to minimize this wastage, allowing precision measurement for any class of detectable stars or galaxies. Moreover, our proposal was implemented in BALROG, software which embeds fake objects in real imaging to accurately characterize measurement biases. We demonstrate this technique with an angular clustering measurement using Dark Energy Survey (DES) data. We first show that recovery of our injected galaxies depends on a variety of survey characteristics in the same way as the real data. We then construct a flux-limited sample of the faintest galaxies in DES, chosen specifically for their sensitivity to depth and seeing variations. Using the synthetic galaxies as randoms in the Landy–Szalay estimator suppresses the effects of variable survey selection by at least two orders of magnitude. With this correction, our measured angular clustering is found to be in excellent agreement with that of a matched sample from much deeper,more »
- Authors:
-
- The Ohio State Univ., Columbus, OH (United States). et al.
- Publication Date:
- Research Org.:
- Fermi National Accelerator Laboratory (FNAL), Batavia, IL (United States); Brookhaven National Laboratory (BNL), Upton, NY (United States)
- Sponsoring Org.:
- USDOE Office of Science (SC), High Energy Physics (HEP)
- Contributing Org.:
- DES Collaboration
- OSTI Identifier:
- 1221330
- Alternate Identifier(s):
- OSTI ID: 1254809
- Report Number(s):
- FERMILAB-PUB-15-307-AE; BNL-112200-2016-JA
Journal ID: ISSN 0035-8711; arXiv eprint number arXiv:1507.08336
- Grant/Contract Number:
- AC02-07CH11359; SC00112704
- Resource Type:
- Accepted Manuscript
- Journal Name:
- Monthly Notices of the Royal Astronomical Society
- Additional Journal Information:
- Journal Volume: 457; Journal ID: ISSN 0035-8711
- Publisher:
- Royal Astronomical Society
- Country of Publication:
- United States
- Language:
- English
- Subject:
- 79 ASTRONOMY AND ASTROPHYSICS
Citation Formats
Suchyta, E. No Galaxy Left Behind: Accurate Measurements with the Faintest Objects in the Dark Energy Survey. United States: N. p., 2016.
Web. doi:10.1093/mnras/stv2953.
Suchyta, E. No Galaxy Left Behind: Accurate Measurements with the Faintest Objects in the Dark Energy Survey. United States. https://doi.org/10.1093/mnras/stv2953
Suchyta, E. Wed .
"No Galaxy Left Behind: Accurate Measurements with the Faintest Objects in the Dark Energy Survey". United States. https://doi.org/10.1093/mnras/stv2953. https://www.osti.gov/servlets/purl/1221330.
@article{osti_1221330,
title = {No Galaxy Left Behind: Accurate Measurements with the Faintest Objects in the Dark Energy Survey},
author = {Suchyta, E.},
abstractNote = {Accurate statistical measurement with large imaging surveys has traditionally required throwing away a sizable fraction of the data. This is because most measurements have relied on selecting nearly complete samples, where variations in the composition of the galaxy population with seeing, depth, or other survey characteristics are small. Here, we introduce a new measurement method that aims to minimize this wastage, allowing precision measurement for any class of detectable stars or galaxies. Moreover, our proposal was implemented in BALROG, software which embeds fake objects in real imaging to accurately characterize measurement biases. We demonstrate this technique with an angular clustering measurement using Dark Energy Survey (DES) data. We first show that recovery of our injected galaxies depends on a variety of survey characteristics in the same way as the real data. We then construct a flux-limited sample of the faintest galaxies in DES, chosen specifically for their sensitivity to depth and seeing variations. Using the synthetic galaxies as randoms in the Landy–Szalay estimator suppresses the effects of variable survey selection by at least two orders of magnitude. With this correction, our measured angular clustering is found to be in excellent agreement with that of a matched sample from much deeper, higher resolution space-based Cosmological Evolution Survey (COSMOS) imaging; over angular scales of 0.°004 < θ < 0.°2, we find a best-fitting scaling amplitude between the DES and COSMOS measurements of 1.00 ± 0.09. We expect this methodology to be broadly useful for extending measurements’ statistical reach in a variety of upcoming imaging surveys.},
doi = {10.1093/mnras/stv2953},
journal = {Monthly Notices of the Royal Astronomical Society},
number = ,
volume = 457,
place = {United States},
year = {Wed Jan 27 00:00:00 EST 2016},
month = {Wed Jan 27 00:00:00 EST 2016}
}
Web of Science
Works referenced in this record:
GalSim: The modular galaxy image simulation toolkit
journal, April 2015
- Rowe, B. T. P.; Jarvis, M.; Mandelbaum, R.
- Astronomy and Computing, Vol. 10
SExtractor: Software for source extraction
journal, June 1996
- Bertin, E.; Arnouts, S.
- Astronomy and Astrophysics Supplement Series, Vol. 117, Issue 2
Accurate photometric redshifts for the CFHT legacy survey calibrated using the VIMOS VLT deep survey
journal, September 2006
- Ilbert, O.; Arnouts, S.; McCracken, H. J.
- Astronomy & Astrophysics, Vol. 457, Issue 3
The APM Galaxy Survey -- III. An analysis of systematic errors in the angular correlation function and cosmological implications
journal, December 1996
- Maddox, S. J.; Efstathiou, G.; Sutherland, W. J.
- Monthly Notices of the Royal Astronomical Society, Vol. 283, Issue 4
Efficient Computation of Cosmic Microwave Background Anisotropies in Closed Friedmann‐Robertson‐Walker Models
journal, August 2000
- Lewis, Antony; Challinor, Anthony; Lasenby, Anthony
- The Astrophysical Journal, Vol. 538, Issue 2
Galaxy clustering, photometric redshifts and diagnosis of systematics in the DES Science Verification data
journal, December 2015
- Crocce, M.; Carretero, J.; Bauer, A. H.
- Monthly Notices of the Royal Astronomical Society, Vol. 455, Issue 4
Representations of world coordinates in FITS
journal, November 2002
- Greisen, E. W.; Calabretta, M. R.
- Astronomy & Astrophysics, Vol. 395, Issue 3
HEALPix: A Framework for High‐Resolution Discretization and Fast Analysis of Data Distributed on the Sphere
journal, April 2005
- Gorski, K. M.; Hivon, E.; Banday, A. J.
- The Astrophysical Journal, Vol. 622, Issue 2
The clustering of luminous red galaxies in the Sloan Digital Sky Survey imaging data
journal, June 2007
- Padmanabhan, Nikhil; Schlegel, David J.; Seljak, Uroš
- Monthly Notices of the Royal Astronomical Society, Vol. 378, Issue 3
Weighing the Giants – II. Improved calibration of photometry from stellar colours and accurate photometric redshifts
journal, February 2014
- Kelly, Patrick L.; von der Linden, Anja; Applegate, Douglas E.
- Monthly Notices of the Royal Astronomical Society, Vol. 439, Issue 1
Methods for rapidly processing angular masks of next-generation galaxy surveys
journal, July 2008
- Swanson, M. E. C.; Tegmark, Max; Hamilton, Andrew J. S.
- Monthly Notices of the Royal Astronomical Society, Vol. 387, Issue 4
The dark Energy Camera
journal, October 2015
- Flaugher, B.; Diehl, H. T.; Honscheid, K.
- The Astronomical Journal, Vol. 150, Issue 5
emcee : The MCMC Hammer
journal, March 2013
- Foreman-Mackey, Daniel; Hogg, David W.; Lang, Dustin
- Publications of the Astronomical Society of the Pacific, Vol. 125, Issue 925
Dynamical analysis of nearby clusters: Automated astrometry from the ground: precision proper motions over a wide field
journal, June 2013
- Bouy, H.; Bertin, E.; Moraux, E.
- Astronomy & Astrophysics, Vol. 554
The effect of redshift-space distortions on projected two-point clustering measurements: Redshift distortions and projected clustering
journal, June 2010
- Nock, Kelly; Percival, Will J.; Ross, Ashley J.
- Monthly Notices of the Royal Astronomical Society, Vol. 407, Issue 1
The clustering of galaxies in the SDSS-III Baryon Oscillation Spectroscopic Survey: analysis of potential systematics: Systematic analysis of BOSS 3D clustering
journal, June 2012
- Ross, Ashley J.; Percival, Will J.; Sánchez, Ariel G.
- Monthly Notices of the Royal Astronomical Society, Vol. 424, Issue 1
Spectroscopic Target Selection for the Sloan Digital Sky Survey: The Luminous Red Galaxy Sample
journal, November 2001
- Eisenstein, Daniel J.; Annis, James; Gunn, James E.
- The Astronomical Journal, Vol. 122, Issue 5
Observational probes of cosmic acceleration
journal, September 2013
- Weinberg, David H.; Mortonson, Michael J.; Eisenstein, Daniel J.
- Physics Reports, Vol. 530, Issue 2
Observational Evidence from Supernovae for an Accelerating Universe and a Cosmological Constant
journal, September 1998
- Riess, Adam G.; Filippenko, Alexei V.; Challis, Peter
- The Astronomical Journal, Vol. 116, Issue 3
Photometric redshift analysis in the Dark Energy Survey Science Verification data
journal, October 2014
- Sánchez, C.; Carrasco Kind, M.; Lin, H.
- Monthly Notices of the Royal Astronomical Society, Vol. 445, Issue 2
The skewness of the aperture mass statistic
journal, July 2004
- Jarvis, M.; Bernstein, G.; Jain, B.
- Monthly Notices of the Royal Astronomical Society, Vol. 352, Issue 1
An Ultra Fast Image Generator (UFig) for wide-field astronomy
journal, February 2013
- Bergé, Joel; Gamper, Lukas; Réfrégier, Alexandre
- Astronomy and Computing, Vol. 1
The First Release COSMOS Optical and Near‐IR Data and Catalog
journal, September 2007
- Capak, P.; Aussel, H.; Ajiki, M.
- The Astrophysical Journal Supplement Series, Vol. 172, Issue 1
Measuring redshift-space distortions using photometric surveys: RSD with photometric data
journal, May 2011
- Ross, Ashley J.; Percival, Will J.; Crocce, Martín
- Monthly Notices of the Royal Astronomical Society, Vol. 415, Issue 3
The Third Gravitational Lensing Accuracy Testing (Great3) Challenge Handbook
journal, April 2014
- Mandelbaum, Rachel; Rowe, Barnaby; Bosch, James
- The Astrophysical Journal Supplement Series, Vol. 212, Issue 1
The Fourth us Naval Observatory ccd Astrograph Catalog (Ucac4)
journal, January 2013
- Zacharias, N.; Finch, C. T.; Girard, T. M.
- The Astronomical Journal, Vol. 145, Issue 2
The Sloan Digital Sky Survey: Technical Summary
journal, September 2000
- York, Donald G.; Adelman, J.; Anderson, Jr., John E.
- The Astronomical Journal, Vol. 120, Issue 3
Estimating the redshift distribution of photometric galaxy samples
journal, October 2008
- Lima, Marcos; Cunha, Carlos E.; Oyaizu, Hiroaki
- Monthly Notices of the Royal Astronomical Society, Vol. 390, Issue 1
Definition of the Flexible Image Transport System (FITS)
journal, September 2001
- Hanisch, R. J.; Farris, A.; Greisen, E. W.
- Astronomy & Astrophysics, Vol. 376, Issue 1
Analysis of Systematic Effects and Statistical Uncertainties in Angular Clustering of Galaxies from Early Sloan Digital Sky Survey Data
journal, November 2002
- Scranton, Ryan; Johnston, David; Dodelson, Scott
- The Astrophysical Journal, Vol. 579, Issue 1
The Two Micron All Sky Survey (2MASS)
journal, February 2006
- Skrutskie, M. F.; Cutri, R. M.; Stiening, R.
- The Astronomical Journal, Vol. 131, Issue 2
Analysis of two-point statistics of cosmic shear: I. Estimators and covariances
journal, November 2002
- Schneider, P.; van Waerbeke, L.; Kilbinger, M.
- Astronomy & Astrophysics, Vol. 396, Issue 1
Designing future dark energy space missions: I. Building
realistic galaxy spectro-photometric catalogs and their first
applications
journal, July 2009
- Jouvel, S.; Kneib, J. -P.; Ilbert, O.
- Astronomy & Astrophysics, Vol. 504, Issue 2
On the Masses of Nebulae and of Clusters of Nebulae
journal, July 1937
- Zwicky, F.
- The Astrophysical Journal, Vol. 86
Ameliorating systematic uncertainties in the angular clustering of galaxies: a study using the SDSS-III: Ameliorating systematic uncertainties in w(θ)
journal, September 2011
- Ross, Ashley J.; Ho, Shirley; Cuesta, Antonio J.
- Monthly Notices of the Royal Astronomical Society, Vol. 417, Issue 2
Stellar Locus Regression: Accurate Color Calibration and the Real-Time Determination of Galaxy Cluster Photometric Redshifts
journal, May 2009
- High, F. William; Stubbs, Christopher W.; Rest, Armin
- The Astronomical Journal, Vol. 138, Issue 1
Weak Gravitational Lensing with COSMOS: Galaxy Selection and Shape Measurements
journal, September 2007
- Leauthaud, Alexie; Massey, Richard; Kneib, Jean‐Paul
- The Astrophysical Journal Supplement Series, Vol. 172, Issue 1
Clustering of photometric luminous red galaxies - I. Growth of structure and baryon acoustic feature: RSD and BAO with photometric LRGs from SDSS
journal, September 2011
- Crocce, M.; Gaztañaga, E.; Cabré, A.
- Monthly Notices of the Royal Astronomical Society, Vol. 417, Issue 4
Bias and variance of angular correlation functions
journal, July 1993
- Landy, Stephen D.; Szalay, Alexander S.
- The Astrophysical Journal, Vol. 412
Subaru Prime Focus Camera — Suprime-Cam
journal, December 2002
- Miyazaki, Satoshi; Komiyama, Yutaka; Sekiguchi, Maki
- Publications of the Astronomical Society of Japan, Vol. 54, Issue 6
Measurements of Ω and Λ from 42 High‐Redshift Supernovae
journal, June 1999
- Perlmutter, S.; Aldering, G.; Goldhaber, G.
- The Astrophysical Journal, Vol. 517, Issue 2
Star/galaxy separation at faint magnitudes: application to a simulated Dark Energy Survey
journal, April 2015
- Soumagnac, M. T.; Abdalla, F. B.; Lahav, O.
- Monthly Notices of the Royal Astronomical Society, Vol. 450, Issue 1
The Angular Correlations of Galaxies in the COSMOS Field
journal, September 2007
- McCracken, H. J.; Peacock, J. A.; Guzzo, L.
- The Astrophysical Journal Supplement Series, Vol. 172, Issue 1
First Measurement of the Clustering Evolution of Photometrically Classified Quasars
journal, February 2006
- Myers, Adam D.; Brunner, Robert J.; Richards, Gordon T.
- The Astrophysical Journal, Vol. 638, Issue 2
Modeling the Transfer Function for the dark Energy Survey
journal, March 2015
- Chang, C.; Busha, M. T.; Wechsler, R. H.
- The Astrophysical Journal, Vol. 801, Issue 2
The Blanco Cosmology Survey: data Acquisition, Processing, Calibration, Quality Diagnostics, and data Release
journal, September 2012
- Desai, S.; Armstrong, R.; Mohr, J. J.
- The Astrophysical Journal, Vol. 757, Issue 1
COSMOS PHOTOMETRIC REDSHIFTS WITH 30-BANDS FOR 2-deg 2
journal, December 2008
- Ilbert, O.; Capak, P.; Salvato, M.
- The Astrophysical Journal, Vol. 690, Issue 2
Photometric Calibration of the First 1.5 Years of the Pan-Starrs1 Survey
journal, August 2012
- Schlafly, E. F.; Finkbeiner, D. P.; Jurić, M.
- The Astrophysical Journal, Vol. 756, Issue 2
Wide-field lensing mass maps from Dark Energy Survey science verification data: Methodology and detailed analysis
journal, July 2015
- Vikram, V.; Chang, C.; Jain, B.
- Physical Review D, Vol. 92, Issue 2
GALSIM: The modular galaxy image simulation toolkit
text, January 2015
- Rowe, Barnaby; Jarvis, Mike; Mandelbaum, Rachel
- Carnegie Mellon University
GALSIM: The modular galaxy image simulation toolkit
text, January 2015
- Rowe, Barnaby; Jarvis, Mike; Mandelbaum, Rachel
- Carnegie Mellon University
Star/galaxy separation at faint magnitudes: application to a simulated Dark Energy Survey
text, January 2015
- Soumagnac, M. T.; Abdalla, F. B.; Lahav, O.
- Oxford University Press
The angular correlations of galaxies in the COSMOS field
text, January 2007
- McCracken, H. J.; Peacock, J. A.; Guzzo, L.
- arXiv
COSMOS Photometric Redshifts with 30-bands for 2-deg2
text, January 2008
- Ilbert, O.; Capak, P.; Salvato, M.
- arXiv
The Blanco Cosmology Survey: Data Acquisition, Processing, Calibration, Quality Diagnostics and Data Release
text, January 2012
- Desai, S.; Armstrong, R.; Mohr, J. J.
- arXiv
Weighing the Giants II: Improved Calibration of Photometry from Stellar Colors and Accurate Photometric Redshifts
text, January 2012
- Kelly, Patrick L.; von der Linden, Anja; Applegate, Douglas E.
- arXiv
The Fourth US Naval Observatory CCD Astrograph Catalog (UCAC4)
text, January 2012
- Zacharias, Norbert; Finch, Charlie; Girard, Terry
- arXiv
Dynamical Analysis of Nearby ClustErs. Automated astrometry from the ground: precision proper motions over wide field
text, January 2013
- Bouy, H.; Bertin, E.; Moraux, E.
- arXiv
The Third Gravitational Lensing Accuracy Testing (GREAT3) Challenge Handbook
text, January 2013
- Mandelbaum, Rachel; Rowe, Barnaby; Bosch, James
- arXiv
Spectroscopic Target Selection for the Sloan Digital Sky Survey: The Luminous Red Galaxy Sample
text, January 2001
- Eisenstein, D. J.; Annis, J.; Gunn, J. E.
- arXiv
Analysis of two-point statistics of cosmic shear: I. Estimators and covariances
text, January 2002
- Schneider, Peter; van Waerbeke, Ludovic; Kilbinger, Martin
- arXiv
HEALPix -- a Framework for High Resolution Discretization, and Fast Analysis of Data Distributed on the Sphere
text, January 2004
- Gorski, K. M.; Hivon, E.; Banday, A. J.
- arXiv
The Clustering of Luminous Red Galaxies in the Sloan Digital Sky Survey Imaging Data
text, January 2006
- Padmanabhan, N.; Schlegel, D. J.; Seljak, U.
- arXiv
Works referencing / citing this record:
Practical Weak-lensing Shear Measurement with Metacalibration
journal, May 2017
- Sheldon, Erin S.; Huff, Eric M.
- The Astrophysical Journal, Vol. 841, Issue 1
Redshift inference from the combination of galaxy colours and clustering in a hierarchical Bayesian model
journal, November 2018
- Sánchez, Carles; Bernstein, Gary M.
- Monthly Notices of the Royal Astronomical Society, Vol. 483, Issue 2
Characterization and photometric performance of the Hyper Suprime-Cam Software Pipeline
journal, December 2017
- Huang, Song; Leauthaud, Alexie; Murata, Ryoma
- Publications of the Astronomical Society of Japan, Vol. 70, Issue SP1
Dark Energy Survey Year 1 Results: The Photometric Data Set for Cosmology
journal, April 2018
- Drlica-Wagner, A.; Sevilla-Noarbe, I.; Rykoff, E. S.
- The Astrophysical Journal Supplement Series, Vol. 235, Issue 2
Dark Energy Survey Year 1 results: validation of weak lensing cluster member contamination estimates from P(z) decomposition
journal, August 2019
- Varga, T. N.; DeRose, J.; Gruen, D.
- Monthly Notices of the Royal Astronomical Society, Vol. 489, Issue 2
Galaxies in X-ray selected clusters and groups in Dark Energy Survey data – II. Hierarchical Bayesian modelling of the red-sequence galaxy luminosity function
journal, June 2019
- Zhang, Y.; Miller, C. J.; Rooney, P.
- Monthly Notices of the Royal Astronomical Society, Vol. 488, Issue 1
Weak lensing magnification in the Dark Energy Survey Science Verification data
journal, February 2018
- Garcia-Fernandez, M.; Sanchez, E.; Sevilla-Noarbe, I.
- Monthly Notices of the Royal Astronomical Society, Vol. 476, Issue 1
The Ly α Luminosity Function and Cosmic Reionization at z ∼ 7.0: A Tale of Two LAGER Fields
journal, November 2019
- Hu, Weida; Wang, Junxian; Zheng, Zhen-Ya
- The Astrophysical Journal, Vol. 886, Issue 2
Dark Energy Survey year 1 results: Galaxy-galaxy lensing
journal, August 2018
- Prat, J.; Sánchez, C.; Fang, Y.
- Physical Review D, Vol. 98, Issue 4
The Dark Energy Survey: more than dark energy – an overview
journal, March 2016
- Abbott, T.; Abdalla, F. B.; Aleksic, J.
- Monthly Notices of the Royal Astronomical Society, Vol. 460, Issue 2, p. 1270-1299
Phenotypic redshifts with self-organizing maps: A novel method to characterize redshift distributions of source galaxies for weak lensing
journal, August 2019
- Buchs, R.; Davis, C.; Gruen, D.
- Monthly Notices of the Royal Astronomical Society, Vol. 489, Issue 1
Towards emulating cosmic shear data: revisiting the calibration of the shear measurements for the Kilo-Degree Survey
journal, April 2019
- Kannawadi, Arun; Hoekstra, Henk; Miller, Lance
- Astronomy & Astrophysics, Vol. 624
Cosmology constraints from shear peak statistics in Dark Energy Survey Science Verification data
journal, August 2016
- Kacprzak, T.; Kirk, D.; Friedrich, O.
- Monthly Notices of the Royal Astronomical Society, Vol. 463, Issue 4
Dark Energy Survey Year 1 Results: Photometric Data Set for Cosmology
text, January 2018
- Drlica-Wagner, A.; Sevilla-Noarbe, I.; Rykoff, Es
- Apollo - University of Cambridge Repository
The Dark Energy Survey: more than dark energy - an overview
text, January 2016
- Collaboration, Dark Energy Survey; Abbott, T.; Abdalla, F. B.
- arXiv
Cosmology constraints from shear peak statistics in Dark Energy Survey Science Verification data
text, January 2016
- Kacprzak, T.; Kirk, D.; Friedrich, O.
- arXiv
Practical Weak Lensing Shear Measurement with Metacalibration
text, January 2017
- Sheldon, Erin S.; Huff, Eric M.
- arXiv
Characterization and Photometric Performance of the Hyper Suprime-Cam Software Pipeline
text, January 2017
- Huang, Song; Leauthaud, Alexie; Murata, Ryoma
- arXiv
Dark Energy Survey Year 1 Results: Photometric Data Set for Cosmology
text, January 2017
- Drlica-Wagner, A.; Sevilla-Noarbe, I.; Rykoff, E. S.
- arXiv
Dark Energy Survey Year 1 Results: Galaxy-Galaxy Lensing
text, January 2017
- Prat, J.; Sánchez, C.; Fang, Y.
- arXiv
Galaxies in X-ray Selected Clusters and Groups in Dark Energy Survey Data II: Hierarchical Bayesian Modeling of the Red-Sequence Galaxy Luminosity Function
preprint, January 2017
- Zhang, Y.; Miller, C. J.; Rooney, P.
- arXiv
Towards emulating cosmic shear data: Revisiting the calibration of the shear measurements for the Kilo-Degree Survey
text, January 2018
- Kannawadi, Arun; Hoekstra, Henk; Miller, Lance
- arXiv
Dark Energy Survey Year 1 results: Validation of weak lensing cluster member contamination estimates from P(z) decomposition
text, January 2018
- Varga, T. N.; DeRose, J.; Gruen, D.
- arXiv
Phenotypic redshifts with self-organizing maps: A novel method to characterize redshift distributions of source galaxies for weak lensing
text, January 2019
- Buchs, R.; Davis, C.; Gruen, D.
- arXiv