Redshift inference from the combination of galaxy colours and clustering in a hierarchical Bayesian model
Abstract
Powerful current and future cosmological constraints using high-precision measurements of the large-scale structure of galaxies and its weak gravitational lensing effects rely on accurate characterization of the redshift distributions of the galaxy samples using only broad-band imaging. In this paper, we present a framework for constraining both the redshift probability distributions of galaxy populations and the redshifts of their individual members. We use a hierarchical Bayesian model (HBM) which provides full posterior distributions on those redshift probability distributions, and, for the first time, we show how to combine survey photometry of single galaxies and the information contained in the galaxy clustering against a well-characterized tracer population in a robust way. One critical approximation turns the HBM into a system amenable to efficient Gibbs sampling. We show that in the absence of photometric information, this method reduces to commonly used clustering redshift estimators. Using a simple model system, we show how the incorporation of clustering information with photo-$$z$$’s tightens redshift posteriors, and can overcome biases or gaps in the coverage of a spectroscopic prior. The method enables the full propagation of redshift uncertainties into cosmological analyses, and uses all the information at hand to reduce those uncertainties and associated potential biases.
- Publication Date:
- Research Org.:
- Univ. of Pennsylvania, Philadelphia, PA (United States)
- Sponsoring Org.:
- USDOE Office of Science (SC); National Science Foundation (NSF)
- OSTI Identifier:
- 1610995
- Grant/Contract Number:
- SC0007901; AST-1311924; AST-1615555
- Resource Type:
- Accepted Manuscript
- Journal Name:
- Monthly Notices of the Royal Astronomical Society
- Additional Journal Information:
- Journal Volume: 483; Journal Issue: 2; Journal ID: ISSN 0035-8711
- Publisher:
- Royal Astronomical Society
- Country of Publication:
- United States
- Language:
- English
- Subject:
- 79 ASTRONOMY AND ASTROPHYSICS; astronomy & astrophysics; cosmology: observations; galaxy: surveys; photometric redshifts
Citation Formats
Sánchez, Carles, and Bernstein, Gary M. Redshift inference from the combination of galaxy colours and clustering in a hierarchical Bayesian model. United States: N. p., 2018.
Web. doi:10.1093/mnras/sty3222.
Sánchez, Carles, & Bernstein, Gary M. Redshift inference from the combination of galaxy colours and clustering in a hierarchical Bayesian model. United States. https://doi.org/10.1093/mnras/sty3222
Sánchez, Carles, and Bernstein, Gary M. Thu .
"Redshift inference from the combination of galaxy colours and clustering in a hierarchical Bayesian model". United States. https://doi.org/10.1093/mnras/sty3222. https://www.osti.gov/servlets/purl/1610995.
@article{osti_1610995,
title = {Redshift inference from the combination of galaxy colours and clustering in a hierarchical Bayesian model},
author = {Sánchez, Carles and Bernstein, Gary M.},
abstractNote = {Powerful current and future cosmological constraints using high-precision measurements of the large-scale structure of galaxies and its weak gravitational lensing effects rely on accurate characterization of the redshift distributions of the galaxy samples using only broad-band imaging. In this paper, we present a framework for constraining both the redshift probability distributions of galaxy populations and the redshifts of their individual members. We use a hierarchical Bayesian model (HBM) which provides full posterior distributions on those redshift probability distributions, and, for the first time, we show how to combine survey photometry of single galaxies and the information contained in the galaxy clustering against a well-characterized tracer population in a robust way. One critical approximation turns the HBM into a system amenable to efficient Gibbs sampling. We show that in the absence of photometric information, this method reduces to commonly used clustering redshift estimators. Using a simple model system, we show how the incorporation of clustering information with photo-$z$’s tightens redshift posteriors, and can overcome biases or gaps in the coverage of a spectroscopic prior. The method enables the full propagation of redshift uncertainties into cosmological analyses, and uses all the information at hand to reduce those uncertainties and associated potential biases.},
doi = {10.1093/mnras/sty3222},
journal = {Monthly Notices of the Royal Astronomical Society},
number = 2,
volume = 483,
place = {United States},
year = {Thu Nov 29 00:00:00 EST 2018},
month = {Thu Nov 29 00:00:00 EST 2018}
}
Free Publicly Available Full Text
Publisher's Version of Record
Other availability
Search WorldCat to find libraries that may hold this journal
Cited by: 34 works
Citation information provided by
Web of Science
Web of Science
Save to My Library
You must Sign In or Create an Account in order to save documents to your library.
Works referenced in this record:
The Baryon Oscillation Spectroscopic Survey of Sdss-Iii
journal, December 2012
- Dawson, Kyle S.; Schlegel, David J.; Ahn, Christopher P.
- The Astronomical Journal, Vol. 145, Issue 1
The Sloan Digital Sky Survey: Technical Summary
journal, September 2000
- York, Donald G.; Adelman, J.; Anderson, Jr., John E.
- The Astronomical Journal, Vol. 120, Issue 3
Using neural networks to estimate redshift distributions. An application to CFHTLenS
journal, March 2015
- Bonnett, Christopher
- Monthly Notices of the Royal Astronomical Society, Vol. 449, Issue 1
TPZ: photometric redshift PDFs and ancillary information by using prediction trees and random forests
journal, May 2013
- Carrasco Kind, Matias; Brunner, Robert J.
- Monthly Notices of the Royal Astronomical Society, Vol. 432, Issue 2
Calibrating Redshift Distributions beyond Spectroscopic Limits with Cross‐Correlations
journal, September 2008
- Newman, Jeffrey A.
- The Astrophysical Journal, Vol. 684, Issue 1
CFHTLenS tomographic weak lensing: quantifying accurate redshift distributions
journal, March 2013
- Benjamin, Jonathan; Van Waerbeke, Ludovic; Heymans, Catherine
- Monthly Notices of the Royal Astronomical Society, Vol. 431, Issue 2
ArborZ: PHOTOMETRIC REDSHIFTS USING BOOSTED DECISION TREES
journal, May 2010
- Gerdes, David W.; Sypniewski, Adam J.; McKay, Timothy A.
- The Astrophysical Journal, Vol. 715, Issue 2
Calibration errors unleashed: effects on cosmological parameters and requirements for large-scale structure surveys
journal, May 2013
- Huterer, Dragan; Cunha, Carlos E.; Fang, Wenjuan
- Monthly Notices of the Royal Astronomical Society, Vol. 432, Issue 4
Dark Energy Survey Year 1 results: cross-correlation redshifts – methods and systematics characterization
journal, February 2018
- Gatti, M.; Vielzeuf, P.; Davis, C.
- Monthly Notices of the Royal Astronomical Society, Vol. 477, Issue 2
Recovering redshift distributions with cross-correlations: pushing the boundaries
journal, April 2013
- Schmidt, Samuel J.; Ménard, Brice; Scranton, Ryan
- Monthly Notices of the Royal Astronomical Society, Vol. 431, Issue 4
No galaxy left behind: accurate measurements with the faintest objects in the Dark Energy Survey
journal, January 2016
- Suchyta, E.; Huff, E. M.; Aleksić, J.
- Monthly Notices of the Royal Astronomical Society, Vol. 457, Issue 1
The WiggleZ Dark Energy Survey: survey design and first data release
journal, January 2010
- Drinkwater, Michael J.; Jurek, Russell J.; Blake, Chris
- Monthly Notices of the Royal Astronomical Society, Vol. 401, Issue 3
CFHTLenS: improving the quality of photometric redshifts with precision photometry★: CFHTLenS: photometric redshifts
journal, February 2012
- Hildebrandt, H.; Erben, T.; Kuijken, K.
- Monthly Notices of the Royal Astronomical Society, Vol. 421, Issue 3
The VIMOS VLT deep survey: First epoch VVDS-deep survey: 11 564 spectra with 17.5
journal, August 2005
- Le Fèvre, O.; Vettolani, G.; Garilli, B.
- Astronomy & Astrophysics, Vol. 439, Issue 3
Fast Hamiltonian sampling for large-scale structure inference: Fast Hamiltonian sampling
journal, June 2010
- Jasche, Jens; Kitaura, Francisco S.
- Monthly Notices of the Royal Astronomical Society, Vol. 407, Issue 1
Galaxies in the Hubble Ultra Deep Field. I. Detection, Multiband Photometry, Photometric Redshifts, and Morphology
journal, July 2006
- Coe, Dan; Benítez, Narciso; Sánchez, Sebastián F.
- The Astronomical Journal, Vol. 132, Issue 2
Inference from Iterative Simulation Using Multiple Sequences
journal, November 1992
- Gelman, Andrew; Rubin, Donald B.
- Statistical Science, Vol. 7, Issue 4
Bayesian Photometric Redshift Estimation
journal, June 2000
- Benitez, Narciso
- The Astrophysical Journal, Vol. 536, Issue 2
The VIMOS-VLT deep survey: Evolution of the galaxy luminosity function up to
journal, August 2005
- Ilbert, O.; Tresse, L.; Zucca, E.
- Astronomy & Astrophysics, Vol. 439, Issue 3
Accurate photometric redshifts for the CFHT legacy survey calibrated using the VIMOS VLT deep survey
journal, September 2006
- Ilbert, O.; Arnouts, S.; McCracken, H. J.
- Astronomy & Astrophysics, Vol. 457, Issue 3
PHAT: PHoto- z Accuracy Testing
journal, November 2010
- Hildebrandt, H.; Arnouts, S.; Capak, P.
- Astronomy & Astrophysics, Vol. 523
ANN z : Estimating Photometric Redshifts Using Artificial Neural Networks
journal, April 2004
- Collister, Adrian A.; Lahav, Ofer
- Publications of the Astronomical Society of the Pacific, Vol. 116, Issue 818
A New Strategy for Deep Wide‐Field High‐Resolution Optical Imaging
journal, June 2000
- Kaiser, N.; Tonry, J. L.; Luppino, G. A.
- Publications of the Astronomical Society of the Pacific, Vol. 112, Issue 772
The dark Energy Camera
journal, October 2015
- Flaugher, B.; Diehl, H. T.; Honscheid, K.
- The Astronomical Journal, Vol. 150, Issue 5
Sample variance in photometric redshift calibration: cosmological biases and survey requirements: Sample variance in photo-z calibration
journal, April 2012
- Cunha, Carlos E.; Huterer, Dragan; Busha, Michael T.
- Monthly Notices of the Royal Astronomical Society, Vol. 423, Issue 1
A Critical Assessment of Photometric Redshift Methods: a Candels Investigation
journal, September 2013
- Dahlen, Tomas; Mobasher, Bahram; Faber, Sandra M.
- The Astrophysical Journal, Vol. 775, Issue 2
Bayesian inference from photometric redshift surveys: Bayesian inference from photo-z surveys
journal, August 2012
- Jasche, Jens; Wandelt, Benjamin D.
- Monthly Notices of the Royal Astronomical Society, Vol. 425, Issue 2
Measuring the redshift evolution of clustering: the Hubble Deep Field South
journal, January 2002
- Arnouts, S.; Moscardini, L.; Vanzella, E.
- Monthly Notices of the Royal Astronomical Society, Vol. 329, Issue 2
KiDS-450: cosmological parameter constraints from tomographic weak gravitational lensing
journal, November 2016
- Hildebrandt, H.; Viola, M.; Heymans, C.
- Monthly Notices of the Royal Astronomical Society, Vol. 465, Issue 2
Dark Energy Survey Year 1 Results: redshift distributions of the weak-lensing source galaxies
journal, April 2018
- Hoyle, B.; Gruen, D.; Bernstein, G. M.
- Monthly Notices of the Royal Astronomical Society, Vol. 478, Issue 1
Bayesian physical reconstruction of initial conditions from large-scale structure surveys
journal, April 2013
- Jasche, Jens; Wandelt, Benjamin D.
- Monthly Notices of the Royal Astronomical Society, Vol. 432, Issue 2
The 2dF Galaxy Redshift Survey: spectra and redshifts
journal, December 2001
- Colless, Matthew; Dalton, Gavin; Maddox, Steve
- Monthly Notices of the Royal Astronomical Society, Vol. 328, Issue 4
Photometric redshift analysis in the Dark Energy Survey Science Verification data
journal, October 2014
- Sánchez, C.; Carrasco Kind, M.; Lin, H.
- Monthly Notices of the Royal Astronomical Society, Vol. 445, Issue 2
Systematic errors in future weak-lensing surveys: requirements and prospects for self-calibration
journal, February 2006
- Huterer, D.; Takada, M.; Bernstein, G.
- Monthly Notices of the Royal Astronomical Society, Vol. 366, Issue 1
Mapping the Galaxy Color–Redshift Relation: Optimal Photometric Redshift Calibration Strategies for Cosmology Surveys
journal, October 2015
- Masters, Daniel; Capak, Peter; Stern, Daniel
- The Astrophysical Journal, Vol. 813, Issue 1
The variance of correlation function estimates
journal, March 1994
- Bernstein, Gary M.
- The Astrophysical Journal, Vol. 424
Measuring the impact of COVID-19 vaccine misinformation on vaccination intent in the UK and USA
journal, February 2021
- Loomba, Sahil; de Figueiredo, Alexandre; Piatek, Simon J.
- Nature Human Behaviour, Vol. 5, Issue 3
Redshift distributions of galaxies in the Dark Energy Survey Science Verification shear catalogue and implications for weak lensing
journal, August 2016
- Bonnett, C.; Troxel, M. A.; Hartley, W.
- Physical Review D, Vol. 94, Issue 4
Hierarchical Bayesian inference of galaxy redshift distributions from photometric surveys
journal, June 2016
- Leistedt, Boris; Mortlock, Daniel J.; Peiris, Hiranya V.
- Monthly Notices of the Royal Astronomical Society, Vol. 460, Issue 4
EAZY: A Fast, Public Photometric Redshift Code
journal, October 2008
- Brammer, Gabriel B.; van Dokkum, Pieter G.; Coppi, Paolo
- The Astrophysical Journal, Vol. 686, Issue 2
Sample variance in photometric redshift calibration: cosmological biases and survey requirements
text, January 2012
- Cunha, Carlos E.; Huterer, Dragan; Busha, Michael T.
- Wiley-Blackwell
Calibrating Redshift Distributions Beyond Spectroscopic Limits with Cross-Correlations
text, January 2008
- Newman, Jeffrey A.
- arXiv
ArborZ: Photometric Redshifts Using Boosted Decision Trees
text, January 2009
- Gerdes, David W.; Sypniewski, Adam J.; McKay, Timothy A.
- arXiv
The WiggleZ Dark Energy Survey: Survey Design and First Data Release
text, January 2009
- Drinkwater, Michael J.; Jurek, Russell J.; Blake, Chris
- arXiv
The Baryon Oscillation Spectroscopic Survey of SDSS-III
text, January 2012
- Dawson, Kyle S.; Schlegel, David J.; Ahn, Christopher P.
- arXiv
Recovering Redshift Distributions with Cross-Correlations: Pushing The Boundaries
text, January 2013
- Schmidt, Samuel; Ménard, Brice; Scranton, Ryan
- arXiv
TPZ : Photometric redshift PDFs and ancillary information by using prediction trees and random forests
text, January 2013
- Kind, M. Carrasco; Brunner, R. J.
- arXiv
A Critical Assessment of Photometric Redshift Methods: A CANDELS Investigation
text, January 2013
- Dahlen, Tomas; Mobasher, Bahram; Faber, Sandra M.
- arXiv
Hierarchical Bayesian inference of galaxy redshift distributions from photometric surveys
text, January 2016
- Leistedt, Boris; Mortlock, Daniel J.; Peiris, Hiranya V.
- arXiv
KiDS-450: Cosmological parameter constraints from tomographic weak gravitational lensing
text, January 2016
- Hildebrandt, H.; Viola, M.; Heymans, C.
- arXiv
Dark Energy Survey Year 1 Results: Redshift distributions of the weak lensing source galaxies
text, January 2017
- Hoyle, B.; Gruen, D.; Bernstein, G. M.
- arXiv
Measuring the Redshift Evolution of Clustering: the Hubble Deep Field South
text, January 2001
- Arnouts, S.; Moscardini, L.; Vanzella, E.
- arXiv
ANNz: estimating photometric redshifts using artificial neural networks
text, January 2003
- Collister, Adrian A.; Lahav, Ofer
- arXiv
Systematic Errors in Future Weak Lensing Surveys: Requirements and Prospects for Self-Calibration
text, January 2005
- Huterer, Dragan; Takada, Masahiro; Bernstein, Gary
- arXiv
Galaxies in the Hubble Ultra Deep Field: I. Detection, Multiband Photometry, Photometric Redshifts, and Morphology
text, January 2006
- Coe, Dan; Benitez, Narciso; Sanchez, Sebastian F.
- arXiv
A New Strategy for Deep Wide-Field High Resolution Optical Imaging
text, January 1999
- Kaiser, N.; Tonry, J. L.; Luppino, G. A.
- arXiv
Works referencing / citing this record:
Estimating redshift distributions using hierarchical logistic Gaussian processes
journal, November 2019
- Rau, Markus Michael; Wilson, Simon; Mandelbaum, Rachel
- Monthly Notices of the Royal Astronomical Society, Vol. 491, Issue 4
Phenotypic redshifts with self-organizing maps: A novel method to characterize redshift distributions of source galaxies for weak lensing
journal, August 2019
- Buchs, R.; Davis, C.; Gruen, D.
- Monthly Notices of the Royal Astronomical Society, Vol. 489, Issue 1
horizon-AGN virtual observatory – 2. Template-free estimates of galaxy properties from colours
journal, September 2019
- Davidzon, I.; Laigle, C.; Capak, P. L.
- Monthly Notices of the Royal Astronomical Society, Vol. 489, Issue 4
Non-Gaussianity constraints using future radio continuum surveys and the multitracer technique
journal, December 2019
- Gomes, Zahra; Camera, Stefano; Jarvis, Matt J.
- Monthly Notices of the Royal Astronomical Society, Vol. 492, Issue 1
Photometric Redshift Calibration Requirements for WFIRST Weak-lensing Cosmology: Predictions from CANDELS
journal, June 2019
- Hemmati, Shoubaneh; Capak, Peter; Masters, Daniel
- The Astrophysical Journal, Vol. 877, Issue 2
Phenotypic redshifts with self-organizing maps: A novel method to characterize redshift distributions of source galaxies for weak lensing
text, January 2019
- Buchs, R.; Davis, C.; Gruen, D.
- arXiv
Non-Gaussianity Constraints using Future Radio Continuum Surveys and the Multi-Tracer Technique
text, January 2019
- Gomes, Zahra; Camera, Stefano; Jarvis, Matt J.
- arXiv