DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Self-consistent redshift estimation using correlation functions without a spectroscopic reference sample

Journal Article · · Monthly Notices of the Royal Astronomical Society
ORCiD logo [1];  [2]
  1. Universitaets-Sternwarte, Fakultaet fuer Physik, Ludwig-Maximilians Universitaet Muenchen, Scheinerstr 1, D-81679 Muenchen, Germany, Max Planck Institute fuer Extraterrestrial Physics, Giessenbachstr 1, D-85748 Garching, Germany
  2. Universitaets-Sternwarte, Fakultaet fuer Physik, Ludwig-Maximilians Universitaet Muenchen, Scheinerstr 1, D-81679 Muenchen, Germany, Max Planck Institute fuer Extraterrestrial Physics, Giessenbachstr 1, D-85748 Garching, Germany, McWilliams Center for Cosmology, Department of Physics, Carnegie Mellon University, Pittsburgh, PA 15213, USA

ABSTRACT We present a new method to estimate redshift distributions and galaxy-dark matter bias parameters using correlation functions in a fully data driven and self-consistent manner. Unlike other machine learning, template, or correlation redshift methods, this approach does not require a reference sample with known redshifts. By measuring the projected cross- and auto-correlations of different galaxy sub-samples, e.g. as chosen by simple cells in colour–magnitude space, we are able to estimate the galaxy-dark matter bias model parameters, and the shape of the redshift distributions of each sub-sample. This method fully marginalizes over a flexible parametrization of the redshift distribution and galaxy-dark matter bias parameters of sub-samples of galaxies, and thus provides a general Bayesian framework to incorporate redshift uncertainty into the cosmological analysis in a data-driven, consistent, and reproducible manner. This result is improved by an order of magnitude by including cross-correlations with the cosmic microwave background and with galaxy–galaxy lensing. We showcase how this method could be applied to real galaxies. By using idealized data vectors, in which all galaxy-dark matter model parameters and redshift distributions are known, this method is demonstrated to recover unbiased estimates on important quantities, such as the offset Δz between the mean of the true and estimated redshift distribution and the 68 per cent, 95 per cent, and 99.5 per cent widths of the redshift distribution to an accuracy required by current and future surveys.

Research Organization:
Carnegie Mellon Univ., Pittsburgh, PA (United States)
Sponsoring Organization:
USDOE Office of Science (SC)
Grant/Contract Number:
SC0011114
OSTI ID:
1503713
Journal Information:
Monthly Notices of the Royal Astronomical Society, Journal Name: Monthly Notices of the Royal Astronomical Society Journal Issue: 3 Vol. 485; ISSN 0035-8711
Publisher:
Royal Astronomical SocietyCopyright Statement
Country of Publication:
United Kingdom
Language:
English

References (62)

Multidimensional indexing tools for the virtual observatory journal October 2007
Neural Networks for Photometric Redshifts Evaluation book January 2003
Measuring photometric redshifts using galaxy images and Deep Neural Networks journal July 2016
LOFAR: The LOw-Frequency ARray journal July 2013
Planck 2015 results : XIII. Cosmological parameters journal September 2016
Planck 2015 results : I. Overview of products and scientific results journal September 2016
A new approach to the optimal target selection problem journal January 2007
Biasing and hierarchical statistics in large-scale structure journal August 1993
The NRAO VLA Sky Survey journal May 1998
Bayesian Photometric Redshift Estimation journal June 2000
The Evolution of Bias journal April 1996
ANN z : Estimating Photometric Redshifts Using Artificial Neural Networks journal April 2004
HEALPix: A Framework for High‐Resolution Discretization and Fast Analysis of Data Distributed on the Sphere journal April 2005
Detection of Cosmic Magnification with the Sloan Digital Sky Survey journal November 2005
Using Galaxy Two‐Point Correlation Functions to Determine the Redshift Distributions of Galaxies Binned by Photometric Redshift journal November 2006
The Importance of Being First: Position Dependent Citation Rates on arXiv:astro-ph journal February 2008
Calibrating Redshift Distributions beyond Spectroscopic Limits with Cross‐Correlations journal September 2008
emcee : The MCMC Hammer
  • Foreman-Mackey, Daniel; Hogg, David W.; Lang, Dustin
  • Publications of the Astronomical Society of the Pacific, Vol. 125, Issue 925 https://doi.org/10.1086/670067
journal March 2013
Sdss-Iii: Massive Spectroscopic Surveys of the Distant Universe, the Milky way, and Extra-Solar Planetary Systems journal August 2011
Spectral Classification and Redshift Measurement for the Sdss-Iii Baryon Oscillation Spectroscopic Survey journal October 2012
ArborZ: PHOTOMETRIC REDSHIFTS USING BOOSTED DECISION TREES journal May 2010
Mapping the Galaxy Color–Redshift Relation: Optimal Photometric Redshift Calibration Strategies for Cosmology Surveys journal October 2015
NINE-YEAR WILKINSON MICROWAVE ANISOTROPY PROBE ( WMAP ) OBSERVATIONS: FINAL MAPS AND RESULTS journal September 2013
The Tenth data Release of the Sloan Digital sky Survey: First Spectroscopic data from the Sdss-Iii Apache Point Observatory Galactic Evolution Experiment journal March 2014
CFHTLenS tomographic weak lensing: quantifying accurate redshift distributions journal March 2013
Recovering redshift distributions with cross-correlations: pushing the boundaries journal April 2013
TPZ: photometric redshift PDFs and ancillary information by using prediction trees and random forests journal May 2013
Star/galaxy separation at faint magnitudes: application to a simulated Dark Energy Survey journal April 2015
Spectroscopic failures in photometric redshift calibration: cosmological biases and survey requirements journal August 2014
Clustering-based redshift estimation: comparison to spectroscopic redshifts journal January 2015
A prescription for galaxy biasing evolution as a nuisance parameter journal February 2015
Accurate photometric redshift probability density estimation – method comparison and application journal August 2015
Using neural networks to estimate redshift distributions. An application to CFHTLenS journal March 2015
CMB lensing tomography with the DES Science Verification galaxies journal January 2016
GAz: a genetic algorithm for photometric redshift estimation journal March 2015
Data augmentation for machine learning redshifts applied to Sloan Digital Sky Survey galaxies journal April 2015
Clustering-based redshift estimation: application to VIPERS/CFHTLS journal July 2016
KiDS-450: cosmological parameter constraints from tomographic weak gravitational lensing journal November 2016
A joint analysis for cosmology and photometric redshift calibration using cross-correlations journal November 2016
Correcting cosmological parameter biases for all redshift surveys induced by estimating and reweighting redshift distributions journal December 2016
Cross-correlation of galaxies and galaxy clusters in the Sloan Digital Sky Survey and the importance of non-Poissonian shot noise journal June 2017
Testing the accuracy of clustering redshifts with simulations journal November 2017
Selection biases in empirical p(z) methods for weak lensing journal February 2017
Cosmological constraints with clustering-based redshifts journal March 2017
Dark Energy Survey Year 1 Results: calibration of redMaGiC redshift distributions in DES and SDSS from cross-correlations journal September 2018
Dark Energy Survey year 1 results: galaxy sample for BAO measurement journal September 2018
Learning from the machine: interpreting machine learning algorithms for point- and extended-source classification journal September 2018
Dark Energy Survey Year 1 results: cross-correlation redshifts – methods and systematics characterization journal February 2018
Cross-correlation redshift calibration without spectroscopic calibration samples in DES Science Verification Data journal March 2018
Dark Energy Survey Year 1 Results: redshift distributions of the weak-lensing source galaxies journal April 2018
Simultaneous constraints on cosmology and photometric redshift bias from weak lensing and galaxy clustering journal September 2016
Cosmological parameters from CMB and other data: A Monte Carlo approach journal November 2002
Dark Energy Survey year 1 results: Galaxy-galaxy lensing journal August 2018
CasJobs and MyDB: A Batch Query Workbench journal January 2008
Myths and truths concerning estimation of power spectra: the case for a hybrid estimator journal April 2004
Systematic errors in future weak-lensing surveys: requirements and prospects for self-calibration journal February 2006
The Zurich Extragalactic Bayesian Redshift Analyzer and its first application: COSMOS journal October 2006
Self-calibration of photometric redshift scatter in weak-lensing surveys journal March 2010
Photometric redshifts: estimating their contamination and distribution using clustering information: Photometric redshift contamination journal August 2010
CFHTLenS: the Canada–France–Hawaii Telescope Lensing Survey: CFHTLenS journal October 2012
The Complete Calibration of the Color–Redshift Relation (C3R2) Survey: Survey Overview and Data Release 1 journal May 2017
The Dark Energy Survey: Data Release 1 journal November 2018