DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: A composite likelihood approach for inference under photometric redshift uncertainty

Journal Article · · Monthly Notices of the Royal Astronomical Society

ABSTRACT Obtaining accurately calibrated redshift distributions of photometric samples is one of the great challenges in photometric surveys like LSST, Euclid, HSC, KiDS, and DES. We present an inference methodology that combines the redshift information from the galaxy photometry with constraints from two-point functions, utilizing cross-correlations with spatially overlapping spectroscopic samples, and illustrate the approach on CosmoDC2 simulations. Our likelihood framework is designed to integrate directly into a typical large-scale structure and weak lensing analysis based on two-point functions. We discuss efficient and accurate inference techniques that allow us to scale the method to the large samples of galaxies to be expected in LSST. We consider statistical challenges like the parametrization of redshift systematics, discuss and evaluate techniques to regularize the sample redshift distributions, and investigate techniques that can help to detect and calibrate sources of systematic error using posterior predictive checks. We evaluate and forecast photometric redshift performance using data from the CosmoDC2 simulations, within which we mimic a DESI-like spectroscopic calibration sample for cross-correlations. Using a combination of spatial cross-correlations and photometry, we show that we can provide calibration of the mean of the sample redshift distribution to an accuracy of at least 0.002(1 + z), consistent with the LSST-Y1 science requirements for weak lensing and large-scale structure probes.

Research Organization:
Carnegie Mellon Univ., Pittsburgh, PA (United States)
Sponsoring Organization:
NASA; USDOE
Contributing Organization:
LSST Dark Energy Science Collaboration
Grant/Contract Number:
AC02-05CH11231; AC02-76SF00515; SC0009999; SC0010118
OSTI ID:
1835167
Journal Information:
Monthly Notices of the Royal Astronomical Society, Journal Name: Monthly Notices of the Royal Astronomical Society Journal Issue: 4 Vol. 509; ISSN 0035-8711
Publisher:
Oxford University PressCopyright Statement
Country of Publication:
United Kingdom
Language:
English

References (92)

Neural Networks for Photometric Redshifts Evaluation book January 2003
Measuring photometric redshifts using galaxy images and Deep Neural Networks journal July 2016
Conditional density estimation tools in python and R with applications to photometric redshifts and likelihood-free cosmological inference journal January 2020
Spectroscopic needs for imaging dark energy experiments journal March 2015
Galacticus: A semi-analytic model of galaxy formation journal February 2012
The many flavours of photometric redshifts journal June 2018
Array programming with NumPy journal September 2020
SciPy 1.0: fundamental algorithms for scientific computing in Python journal February 2020
Measuring and modelling the redshift evolution of clustering: the Hubble Deep Field North journal December 1999
Scale dependence of galaxy biasing investigated by weak gravitational lensing: An assessment using semi-analytic galaxies and simulated lensing data journal May 2018
KiDS+VIKING-450 and DES-Y1 combined: Cosmology with cosmic shear journal May 2020
Testing KiDS cross-correlation redshifts with simulations journal October 2020
KiDS-1000 catalogue: Weak gravitational lensing shear measurements journal January 2021
KiDS-1000 catalogue: Redshift distributions and their calibration journal March 2021
KiDS-1000 Cosmology: Multi-probe weak gravitational lensing and spectroscopic galaxy clustering constraints journal February 2021
Accurate photometric redshifts for the CFHT legacy survey calibrated using the VIMOS VLT deep survey journal September 2006
Optimal Rates of Convergence for Deconvolving a Density journal December 1988
Bayesian Photometric Redshift Estimation journal June 2000
ANN z : Estimating Photometric Redshifts Using Artificial Neural Networks journal April 2004
Detection of Cosmic Magnification with the Sloan Digital Sky Survey journal November 2005
Effects of Photometric Redshift Uncertainties on Weak‐Lensing Tomography journal January 2006
Calibrating Redshift Distributions beyond Spectroscopic Limits with Cross‐Correlations journal September 2008
ArborZ: PHOTOMETRIC REDSHIFTS USING BOOSTED DECISION TREES journal May 2010
An Atlas of Galaxy Spectral Energy Distributions from the Ultraviolet to the Mid-Infrared journal May 2014
Tomographic galaxy clustering with the Subaru Hyper Suprime-Cam first year public data release journal March 2020
Analytic marginalization of N ( z ) uncertainties in tomographic galaxy surveys journal October 2020
Logistic-normal distributions:Some properties and uses journal January 1980
Redshift evolution of clustering journal March 1997
Generating synthetic cosmological data with GalSampler journal June 2020
The impact of spectroscopic incompleteness in direct calibration of redshift distributions for weak lensing surveys journal June 2020
Redshift inference from the combination of galaxy colours and clustering in a hierarchical Bayesian model – Application to realistic N-body simulations journal August 2020
Propagating sample variance uncertainties in redshift calibration: simulations, theory, and application to the COSMOS2015 data journal August 2020
The PAU Survey: an improved photo- z sample in the COSMOS field journal January 2021
The Clustering of DESI-like Luminous Red Galaxies Using Photometric Redshifts journal December 2020
Dark Energy Survey Year 3 results: redshift calibration of the weak lensing source galaxies journal May 2021
Dark Energy Survey Year 3 Results: Clustering redshifts – calibration of the weak lensing source redshift distributions with redMaGiC and BOSS/eBOSS journal November 2021
CFHTLenS tomographic weak lensing: quantifying accurate redshift distributions journal March 2013
Recovering redshift distributions with cross-correlations: pushing the boundaries journal April 2013
TPZ: photometric redshift PDFs and ancillary information by using prediction trees and random forests journal May 2013
On using angular cross-correlations to determine source redshift distributions journal July 2013
Spectroscopic failures in photometric redshift calibration: cosmological biases and survey requirements journal August 2014
A prescription for galaxy biasing evolution as a nuisance parameter journal February 2015
Photometric redshifts and model spectral energy distributions of galaxies from the SDSS-III BOSS DR10 data journal June 2015
Accurate photometric redshift probability density estimation – method comparison and application journal August 2015
Using neural networks to estimate redshift distributions. An application to CFHTLenS journal March 2015
Data augmentation for machine learning redshifts applied to Sloan Digital Sky Survey galaxies journal April 2015
Hierarchical Bayesian inference of galaxy redshift distributions from photometric surveys journal June 2016
Clustering-based redshift estimation: application to VIPERS/CFHTLS journal July 2016
KiDS-450: cosmological parameter constraints from tomographic weak gravitational lensing journal November 2016
A joint analysis for cosmology and photometric redshift calibration using cross-correlations journal November 2016
2dFLenS and KiDS: determining source redshift distributions with cross-correlations journal November 2016
Correcting cosmological parameter biases for all redshift surveys induced by estimating and reweighting redshift distributions journal December 2016
Galaxy bias from the Dark Energy Survey Science Verification data: combining galaxy density maps and weak lensing maps journal April 2016
Galaxy bias from galaxy–galaxy lensing in the DES science verification data journal September 2017
KiDS-450 + 2dFLenS: Cosmological parameter constraints from weak gravitational lensing tomography and overlapping redshift-space galaxy clustering journal October 2017
the-wizz: clustering redshift estimation for everyone journal February 2017
Cosmological constraints with clustering-based redshifts journal March 2017
Redshift inference from the combination of galaxy colours and clustering in a hierarchical Bayesian model journal November 2018
Bayesian photometric redshifts of blended sources journal December 2018
Dark Energy Survey Year 1 results: cross-correlation redshifts – methods and systematics characterization journal February 2018
A cross-correlation-based estimate of the galaxy luminosity function journal March 2018
KiDS+GAMA: cosmology constraints from a joint analysis of cosmic shear, galaxy–galaxy lensing, and angular clustering journal March 2018
Dark Energy Survey Year 1 Results: redshift distributions of the weak-lensing source galaxies journal April 2018
Cosmological lensing ratios with DES Y1, SPT, and Planck journal May 2019
Estimating redshift distributions using hierarchical logistic Gaussian processes journal November 2019
Self-consistent redshift estimation using correlation functions without a spectroscopic reference sample journal February 2019
Likelihood non-Gaussianity in large-scale structure analyses journal February 2019
The Hyper Suprime-Cam SSP Survey: Overview and survey design journal September 2017
Photometric redshifts for Hyper Suprime-Cam Subaru Strategic Program Data Release 1 journal October 2017
Cosmology from cosmic shear power spectra with Subaru Hyper Suprime-Cam first-year data journal March 2019
Joining forces of Bayesian and frequentist methodology: a study for inference in the presence of non-identifiability
  • Raue, Andreas; Kreutz, Clemens; Theis, Fabian Joachim
  • Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences, Vol. 371, Issue 1984 https://doi.org/10.1098/rsta.2011.0544
journal February 2013
Dark Energy Survey year 1 results: Cosmological constraints from galaxy clustering and weak lensing journal August 2018
IPython: A System for Interactive Scientific Computing journal January 2007
Matplotlib: A 2D Graphics Environment journal January 2007
Calibrating photometric redshifts of luminous red galaxies journal May 2005
Systematic errors in future weak-lensing surveys: requirements and prospects for self-calibration journal February 2006
The Zurich Extragalactic Bayesian Redshift Analyzer and its first application: COSMOS journal October 2006
Catastrophic photometric redshift errors: weak-lensing survey requirements journal January 2010
XGBoost: A Scalable Tree Boosting System conference January 2016
Weak Lensing for Precision Cosmology journal September 2018
Approximating Probability Densities by Iterated Laplace Approximations journal January 2011
Converting high-dimensional regression to high-dimensional conditional density estimation journal January 2017
A Note on the Generation of Random Normal Deviates journal June 1958
Identification in Parametric Models journal May 1971
Data Structures for Statistical Computing in Python conference January 2010
Estimating Spectra from Photometry journal December 2017
Photometric Redshifts with the LSST. II. The Impact of Near-infrared and Near-ultraviolet Photometry journal May 2020
LSST: From Science Drivers to Reference Design and Anticipated Data Products journal March 2019
The Dark Energy Survey: Data Release 1 journal November 2018
The Outer Rim Simulation: A Path to Many-core Supercomputers journal November 2019
CosmoDC2: A Synthetic Sky Catalog for Dark Energy Science with LSST journal December 2019
Preliminary Target Selection for the DESI Luminous Red Galaxy (LRG) Sample journal October 2020