Redshift inference from the combination of galaxy colours and clustering in a hierarchical Bayesian model

Sánchez, Carles; Bernstein, Gary M.

doi:10.1093/mnras/sty3222

Title: Redshift inference from the combination of galaxy colours and clustering in a hierarchical Bayesian model

Journal Article · 29 November 2018 · Monthly Notices of the Royal Astronomical Society

DOI: https://doi.org/10.1093/mnras/sty3222 · OSTI ID:1610995

^[1]; Bernstein, Gary M. ^[2]

Univ. of Pennsylvania, Philadelphia, PA (United States); DOE/OSTI
Univ. of Pennsylvania, Philadelphia, PA (United States)

Powerful current and future cosmological constraints using high-precision measurements of the large-scale structure of galaxies and its weak gravitational lensing effects rely on accurate characterization of the redshift distributions of the galaxy samples using only broad-band imaging. In this paper, we present a framework for constraining both the redshift probability distributions of galaxy populations and the redshifts of their individual members. We use a hierarchical Bayesian model (HBM) which provides full posterior distributions on those redshift probability distributions, and, for the first time, we show how to combine survey photometry of single galaxies and the information contained in the galaxy clustering against a well-characterized tracer population in a robust way. One critical approximation turns the HBM into a system amenable to efficient Gibbs sampling. We show that in the absence of photometric information, this method reduces to commonly used clustering redshift estimators. Using a simple model system, we show how the incorporation of clustering information with photo-$$z$$’s tightens redshift posteriors, and can overcome biases or gaps in the coverage of a spectroscopic prior. The method enables the full propagation of redshift uncertainties into cosmological analyses, and uses all the information at hand to reduce those uncertainties and associated potential biases.

View Accepted Manuscript (DOE)

Cite

Export

Save

Research Organization:: Univ. of Pennsylvania, Philadelphia, PA (United States)

Sponsoring Organization:: National Science Foundation (NSF); USDOE Office of Science (SC)

Grant/Contract Number:: SC0007901

OSTI ID:: 1610995

Journal Information:: Monthly Notices of the Royal Astronomical Society, Journal Name: Monthly Notices of the Royal Astronomical Society Journal Issue: 2 Vol. 483; ISSN 0035-8711

Publisher:: Royal Astronomical SocietyCopyright Statement

Country of Publication:: United States

Language:: English

References (58)

Measuring the impact of COVID-19 vaccine misinformation on vaccination intent in the UK and USA Loomba, Sahil; de Figueiredo, Alexandre; Piatek, Simon J. Nature Human Behaviour, Vol. 5, Issue 3 https://doi.org/10.1038/s41562-021-01056-1	journal	February 2021
The 2dF Galaxy Redshift Survey: spectra and redshifts Colless, Matthew; Dalton, Gavin; Maddox, Steve Monthly Notices of the Royal Astronomical Society, Vol. 328, Issue 4 https://doi.org/10.1046/j.1365-8711.2001.04902.x	journal	December 2001
Measuring the redshift evolution of clustering: the Hubble Deep Field South Arnouts, S.; Moscardini, L.; Vanzella, E. Monthly Notices of the Royal Astronomical Society, Vol. 329, Issue 2 https://doi.org/10.1046/j.1365-8711.2002.04988.x	journal	January 2002
PHAT: PHoto- z Accuracy Testing Hildebrandt, H.; Arnouts, S.; Capak, P. Astronomy & Astrophysics, Vol. 523 https://doi.org/10.1051/0004-6361/201014885	journal	November 2010
The VIMOS VLT deep survey: First epoch VVDS-deep survey: 11 564 spectra with 17.5 Le Fèvre, O.; Vettolani, G.; Garilli, B. Astronomy & Astrophysics, Vol. 439, Issue 3 https://doi.org/10.1051/0004-6361:20041960	journal	August 2005
The VIMOS-VLT deep survey: Evolution of the galaxy luminosity function up to Ilbert, O.; Tresse, L.; Zucca, E. Astronomy & Astrophysics, Vol. 439, Issue 3 https://doi.org/10.1051/0004-6361:20041961	journal	August 2005
Accurate photometric redshifts for the CFHT legacy survey calibrated using the VIMOS VLT deep survey Ilbert, O.; Arnouts, S.; McCracken, H. J. Astronomy & Astrophysics, Vol. 457, Issue 3 https://doi.org/10.1051/0004-6361:20065138	journal	September 2006
The variance of correlation function estimates Bernstein, Gary M. The Astrophysical Journal, Vol. 424 https://doi.org/10.1086/173915	journal	March 1994
The Sloan Digital Sky Survey: Technical Summary York, Donald G.; Adelman, J.; Anderson, Jr., John E. The Astronomical Journal, Vol. 120, Issue 3 https://doi.org/10.1086/301513	journal	September 2000
Bayesian Photometric Redshift Estimation Benitez, Narciso The Astrophysical Journal, Vol. 536, Issue 2 https://doi.org/10.1086/308947	journal	June 2000
A New Strategy for Deep Wide‐Field High‐Resolution Optical Imaging Kaiser, N.; Tonry, J. L.; Luppino, G. A. Publications of the Astronomical Society of the Pacific, Vol. 112, Issue 772 https://doi.org/10.1086/316578	journal	June 2000
ANN z : Estimating Photometric Redshifts Using Artificial Neural Networks Collister, Adrian A.; Lahav, Ofer Publications of the Astronomical Society of the Pacific, Vol. 116, Issue 818 https://doi.org/10.1086/383254	journal	April 2004
Galaxies in the Hubble Ultra Deep Field. I. Detection, Multiband Photometry, Photometric Redshifts, and Morphology Coe, Dan; Benítez, Narciso; Sánchez, Sebastián F. The Astronomical Journal, Vol. 132, Issue 2 https://doi.org/10.1086/505530	journal	July 2006
Calibrating Redshift Distributions beyond Spectroscopic Limits with Cross‐Correlations Newman, Jeffrey A. The Astrophysical Journal, Vol. 684, Issue 1 https://doi.org/10.1086/589982	journal	September 2008
EAZY: A Fast, Public Photometric Redshift Code Brammer, Gabriel B.; van Dokkum, Pieter G.; Coppi, Paolo The Astrophysical Journal, Vol. 686, Issue 2 https://doi.org/10.1086/591786	journal	October 2008
The Baryon Oscillation Spectroscopic Survey of Sdss-Iii Dawson, Kyle S.; Schlegel, David J.; Ahn, Christopher P. The Astronomical Journal, Vol. 145, Issue 1 https://doi.org/10.1088/0004-6256/145/1/10	journal	December 2012
The dark Energy Camera Flaugher, B.; Diehl, H. T.; Honscheid, K. The Astronomical Journal, Vol. 150, Issue 5 https://doi.org/10.1088/0004-6256/150/5/150	journal	October 2015
ArborZ: PHOTOMETRIC REDSHIFTS USING BOOSTED DECISION TREES Gerdes, David W.; Sypniewski, Adam J.; McKay, Timothy A. The Astrophysical Journal, Vol. 715, Issue 2 https://doi.org/10.1088/0004-637X/715/2/823	journal	May 2010
A Critical Assessment of Photometric Redshift Methods: a Candels Investigation Dahlen, Tomas; Mobasher, Bahram; Faber, Sandra M. The Astrophysical Journal, Vol. 775, Issue 2 https://doi.org/10.1088/0004-637X/775/2/93	journal	September 2013
Mapping the Galaxy Color–Redshift Relation: Optimal Photometric Redshift Calibration Strategies for Cosmology Surveys Masters, Daniel; Capak, Peter; Stern, Daniel The Astrophysical Journal, Vol. 813, Issue 1 https://doi.org/10.1088/0004-637X/813/1/53	journal	October 2015
CFHTLenS tomographic weak lensing: quantifying accurate redshift distributions Benjamin, Jonathan; Van Waerbeke, Ludovic; Heymans, Catherine Monthly Notices of the Royal Astronomical Society, Vol. 431, Issue 2 https://doi.org/10.1093/mnras/stt276	journal	March 2013
Recovering redshift distributions with cross-correlations: pushing the boundaries Schmidt, Samuel J.; Ménard, Brice; Scranton, Ryan Monthly Notices of the Royal Astronomical Society, Vol. 431, Issue 4 https://doi.org/10.1093/mnras/stt410	journal	April 2013
Bayesian physical reconstruction of initial conditions from large-scale structure surveys Jasche, Jens; Wandelt, Benjamin D. Monthly Notices of the Royal Astronomical Society, Vol. 432, Issue 2 https://doi.org/10.1093/mnras/stt449	journal	April 2013
TPZ: photometric redshift PDFs and ancillary information by using prediction trees and random forests Carrasco Kind, Matias; Brunner, Robert J. Monthly Notices of the Royal Astronomical Society, Vol. 432, Issue 2 https://doi.org/10.1093/mnras/stt574	journal	May 2013
Calibration errors unleashed: effects on cosmological parameters and requirements for large-scale structure surveys Huterer, Dragan; Cunha, Carlos E.; Fang, Wenjuan Monthly Notices of the Royal Astronomical Society, Vol. 432, Issue 4 https://doi.org/10.1093/mnras/stt653	journal	May 2013
Photometric redshift analysis in the Dark Energy Survey Science Verification data Sánchez, C.; Carrasco Kind, M.; Lin, H. Monthly Notices of the Royal Astronomical Society, Vol. 445, Issue 2 https://doi.org/10.1093/mnras/stu1836	journal	October 2014
Using neural networks to estimate redshift distributions. An application to CFHTLenS Bonnett, Christopher Monthly Notices of the Royal Astronomical Society, Vol. 449, Issue 1 https://doi.org/10.1093/mnras/stv230	journal	March 2015
No galaxy left behind: accurate measurements with the faintest objects in the Dark Energy Survey Suchyta, E.; Huff, E. M.; Aleksić, J. Monthly Notices of the Royal Astronomical Society, Vol. 457, Issue 1 https://doi.org/10.1093/mnras/stv2953	journal	January 2016
Hierarchical Bayesian inference of galaxy redshift distributions from photometric surveys Leistedt, Boris; Mortlock, Daniel J.; Peiris, Hiranya V. Monthly Notices of the Royal Astronomical Society, Vol. 460, Issue 4 https://doi.org/10.1093/mnras/stw1304	journal	June 2016
KiDS-450: cosmological parameter constraints from tomographic weak gravitational lensing Hildebrandt, H.; Viola, M.; Heymans, C. Monthly Notices of the Royal Astronomical Society, Vol. 465, Issue 2 https://doi.org/10.1093/mnras/stw2805	journal	November 2016
Dark Energy Survey Year 1 results: cross-correlation redshifts – methods and systematics characterization Gatti, M.; Vielzeuf, P.; Davis, C. Monthly Notices of the Royal Astronomical Society, Vol. 477, Issue 2 https://doi.org/10.1093/mnras/sty466	journal	February 2018
Dark Energy Survey Year 1 Results: redshift distributions of the weak-lensing source galaxies Hoyle, B.; Gruen, D.; Bernstein, G. M. Monthly Notices of the Royal Astronomical Society, Vol. 478, Issue 1 https://doi.org/10.1093/mnras/sty957	journal	April 2018
Redshift distributions of galaxies in the Dark Energy Survey Science Verification shear catalogue and implications for weak lensing Bonnett, C.; Troxel, M. A.; Hartley, W. Physical Review D, Vol. 94, Issue 4 https://doi.org/10.1103/PhysRevD.94.042005	journal	August 2016
Systematic errors in future weak-lensing surveys: requirements and prospects for self-calibration Huterer, D.; Takada, M.; Bernstein, G. Monthly Notices of the Royal Astronomical Society, Vol. 366, Issue 1 https://doi.org/10.1111/j.1365-2966.2005.09782.x	journal	February 2006
The WiggleZ Dark Energy Survey: survey design and first data release Drinkwater, Michael J.; Jurek, Russell J.; Blake, Chris Monthly Notices of the Royal Astronomical Society, Vol. 401, Issue 3 https://doi.org/10.1111/j.1365-2966.2009.15754.x	journal	January 2010
Fast Hamiltonian sampling for large-scale structure inference: Fast Hamiltonian sampling Jasche, Jens; Kitaura, Francisco S. Monthly Notices of the Royal Astronomical Society, Vol. 407, Issue 1 https://doi.org/10.1111/j.1365-2966.2010.16897.x	journal	June 2010
CFHTLenS: improving the quality of photometric redshifts with precision photometry★: CFHTLenS: photometric redshifts Hildebrandt, H.; Erben, T.; Kuijken, K. Monthly Notices of the Royal Astronomical Society, Vol. 421, Issue 3 https://doi.org/10.1111/j.1365-2966.2012.20468.x	journal	February 2012
Sample variance in photometric redshift calibration: cosmological biases and survey requirements: Sample variance in photo-z calibration Cunha, Carlos E.; Huterer, Dragan; Busha, Michael T. Monthly Notices of the Royal Astronomical Society, Vol. 423, Issue 1 https://doi.org/10.1111/j.1365-2966.2012.20927.x	journal	April 2012
Bayesian inference from photometric redshift surveys: Bayesian inference from photo-z surveys Jasche, Jens; Wandelt, Benjamin D. Monthly Notices of the Royal Astronomical Society, Vol. 425, Issue 2 https://doi.org/10.1111/j.1365-2966.2012.21423.x	journal	August 2012
Inference from Iterative Simulation Using Multiple Sequences Gelman, Andrew; Rubin, Donald B. Statistical Science, Vol. 7, Issue 4 https://doi.org/10.1214/ss/1177011136	journal	November 1992
Calibrating Redshift Distributions Beyond Spectroscopic Limits with Cross-Correlations Newman, Jeffrey A. arXiv https://doi.org/10.48550/arxiv.0805.1409	text	January 2008
ArborZ: Photometric Redshifts Using Boosted Decision Trees Gerdes, David W.; Sypniewski, Adam J.; McKay, Timothy A. arXiv https://doi.org/10.48550/arxiv.0908.4085	text	January 2009
The WiggleZ Dark Energy Survey: Survey Design and First Data Release Drinkwater, Michael J.; Jurek, Russell J.; Blake, Chris arXiv https://doi.org/10.48550/arxiv.0911.4246	text	January 2009
PHAT: PHoto-z Accuracy Testing Hildebrandt, H.; Arnouts, S.; Capak, P. arXiv https://doi.org/10.48550/arxiv.1008.0658	text	January 2010
The Baryon Oscillation Spectroscopic Survey of SDSS-III Dawson, Kyle S.; Schlegel, David J.; Ahn, Christopher P. arXiv https://doi.org/10.48550/arxiv.1208.0022	text	January 2012
Recovering Redshift Distributions with Cross-Correlations: Pushing The Boundaries Schmidt, Samuel; Ménard, Brice; Scranton, Ryan arXiv https://doi.org/10.48550/arxiv.1303.0292	text	January 2013
TPZ : Photometric redshift PDFs and ancillary information by using prediction trees and random forests Kind, M. Carrasco; Brunner, R. J. arXiv https://doi.org/10.48550/arxiv.1303.7269	text	January 2013
A Critical Assessment of Photometric Redshift Methods: A CANDELS Investigation Dahlen, Tomas; Mobasher, Bahram; Faber, Sandra M. arXiv https://doi.org/10.48550/arxiv.1308.5353	text	January 2013
Hierarchical Bayesian inference of galaxy redshift distributions from photometric surveys Leistedt, Boris; Mortlock, Daniel J.; Peiris, Hiranya V. arXiv https://doi.org/10.48550/arxiv.1602.05960	text	January 2016
KiDS-450: Cosmological parameter constraints from tomographic weak gravitational lensing Hildebrandt, H.; Viola, M.; Heymans, C. arXiv https://doi.org/10.48550/arxiv.1606.05338	text	January 2016
Dark Energy Survey Year 1 Results: Redshift distributions of the weak lensing source galaxies Hoyle, B.; Gruen, D.; Bernstein, G. M. arXiv https://doi.org/10.48550/arxiv.1708.01532	text	January 2017
Measuring the Redshift Evolution of Clustering: the Hubble Deep Field South Arnouts, S.; Moscardini, L.; Vanzella, E. arXiv https://doi.org/10.48550/arxiv.astro-ph/0109453	text	January 2001
ANNz: estimating photometric redshifts using artificial neural networks Collister, Adrian A.; Lahav, Ofer arXiv https://doi.org/10.48550/arxiv.astro-ph/0311058	text	January 2003
Systematic Errors in Future Weak Lensing Surveys: Requirements and Prospects for Self-Calibration Huterer, Dragan; Takada, Masahiro; Bernstein, Gary arXiv https://doi.org/10.48550/arxiv.astro-ph/0506030	text	January 2005
Galaxies in the Hubble Ultra Deep Field: I. Detection, Multiband Photometry, Photometric Redshifts, and Morphology Coe, Dan; Benitez, Narciso; Sanchez, Sebastian F. arXiv https://doi.org/10.48550/arxiv.astro-ph/0605262	text	January 2006
Bayesian photometric redshift estimation Benitez, Narciso arXiv https://doi.org/10.48550/arxiv.astro-ph/9811189	text	January 1998
A New Strategy for Deep Wide-Field High Resolution Optical Imaging Kaiser, N.; Tonry, J. L.; Luppino, G. A. arXiv https://doi.org/10.48550/arxiv.astro-ph/9912181	text	January 1999
Sample variance in photometric redshift calibration: cosmological biases and survey requirements Cunha, Carlos E.; Huterer, Dragan; Busha, Michael T. Wiley-Blackwell https://doi.org/10.5167/uzh-70383	text	January 2012

Cited By (7)

Phenotypic redshifts with self-organizing maps: A novel method to characterize redshift distributions of source galaxies for weak lensing Buchs, R.; Davis, C.; Gruen, D. Monthly Notices of the Royal Astronomical Society, Vol. 489, Issue 1 https://doi.org/10.1093/mnras/stz2162	journal	August 2019
horizon-AGN virtual observatory – 2. Template-free estimates of galaxy properties from colours Davidzon, I.; Laigle, C.; Capak, P. L. Monthly Notices of the Royal Astronomical Society, Vol. 489, Issue 4 https://doi.org/10.1093/mnras/stz2486	journal	September 2019
Estimating redshift distributions using hierarchical logistic Gaussian processes Rau, Markus Michael; Wilson, Simon; Mandelbaum, Rachel Monthly Notices of the Royal Astronomical Society, Vol. 491, Issue 4 https://doi.org/10.1093/mnras/stz3295	journal	November 2019
Non-Gaussianity constraints using future radio continuum surveys and the multitracer technique Gomes, Zahra; Camera, Stefano; Jarvis, Matt J. Monthly Notices of the Royal Astronomical Society, Vol. 492, Issue 1 https://doi.org/10.1093/mnras/stz3581	journal	December 2019
Photometric Redshift Calibration Requirements for WFIRST Weak-lensing Cosmology: Predictions from CANDELS Hemmati, Shoubaneh; Capak, Peter; Masters, Daniel The Astrophysical Journal, Vol. 877, Issue 2 https://doi.org/10.3847/1538-4357/ab1be5	journal	June 2019
Phenotypic redshifts with self-organizing maps: A novel method to characterize redshift distributions of source galaxies for weak lensing Buchs, R.; Davis, C.; Gruen, D. arXiv https://doi.org/10.48550/arxiv.1901.05005	text	January 2019
Non-Gaussianity Constraints using Future Radio Continuum Surveys and the Multi-Tracer Technique Gomes, Zahra; Camera, Stefano; Jarvis, Matt J. arXiv https://doi.org/10.48550/arxiv.1912.08362	text	January 2019

Similar Records

Redshift inference from the combination of galaxy colours and clustering in a hierarchical Bayesian model – Application to realistic N -body simulations

Journal Article · 2020 · Monthly Notices of the Royal Astronomical Society · OSTI ID:1664504

Alarcon, Alex; Sánchez, Carles; Bernstein, Gary M.; +1 more

Hierarchical Modeling and Statistical Calibration for Photometric Redshifts

Journal Article · 2019 · The Astrophysical Journal (Online) · OSTI ID:1562502

Leistedt, Boris; Hogg, David W.; Wechsler, Risa H.; +1 more

Estimating redshift distributions using hierarchical logistic Gaussian processes

Journal Article · 2019 · Monthly Notices of the Royal Astronomical Society · OSTI ID:1579995

Rau, Markus Michael; Wilson, Simon; Mandelbaum, Rachel

Related Subjects

79 ASTRONOMY AND ASTROPHYSICS
astronomy & astrophysics
cosmology: observations
galaxy: surveys
photometric redshifts

Title: Redshift inference from the combination of galaxy colours and clustering in a hierarchical Bayesian model

Citation Formats

References (58)

Cited By (7)

Similar Records

Related Subjects