Catastrophic photometric redshift errors: Weak-lensing survey requirements
Abstract
We study the sensitivity of weak lensing surveys to the effects of catastrophic redshift errors - cases where the true redshift is misestimated by a significant amount. To compute the biases in cosmological parameters, we adopt an efficient linearized analysis where the redshift errors are directly related to shifts in the weak lensing convergence power spectra. We estimate the number Nspec of unbiased spectroscopic redshifts needed to determine the catastrophic error rate well enough that biases in cosmological parameters are below statistical errors of weak lensing tomography. While the straightforward estimate of Nspec is ~106 we find that using only the photometric redshifts with z ≤ 2.5 leads to a drastic reduction in Nspec to ~ 30,000 while negligibly increasing statistical errors in dark energy parameters. Therefore, the size of spectroscopic survey needed to control catastrophic errors is similar to that previously deemed necessary to constrain the core of the zs – zp distribution. We also study the efficacy of the recent proposal to measure redshift errors by cross-correlation between the photo-z and spectroscopic samples. We find that this method requires ~ 10% a priori knowledge of the bias and stochasticity of the outlier population, and is also easily confoundedmore »
- Authors:
-
- Univ. of Pennsylvania, Philadelphia, PA (United States)
- Univ. of Michigan, Ann Arbor, MI (United States)
- Publication Date:
- Research Org.:
- Univ. of Pennsylvania, Philadelphia, PA (United States)
- Sponsoring Org.:
- USDOE Office of Science (SC), High Energy Physics (HEP)
- OSTI Identifier:
- 1203553
- Grant/Contract Number:
- FG02-95ER40893
- Resource Type:
- Accepted Manuscript
- Journal Name:
- Monthly Notices of the Royal Astronomical Society
- Additional Journal Information:
- Journal Volume: 401; Journal Issue: 2; Journal ID: ISSN 0035-8711
- Publisher:
- Royal Astronomical Society
- Country of Publication:
- United States
- Language:
- English
- Subject:
- 79 ASTRONOMY AND ASTROPHYSICS; sensitivity of weak-lensing; gravitational lensing
Citation Formats
Bernstein, Gary, and Huterer, Dragan. Catastrophic photometric redshift errors: Weak-lensing survey requirements. United States: N. p., 2010.
Web. doi:10.1111/j.1365-2966.2009.15748.x.
Bernstein, Gary, & Huterer, Dragan. Catastrophic photometric redshift errors: Weak-lensing survey requirements. United States. https://doi.org/10.1111/j.1365-2966.2009.15748.x
Bernstein, Gary, and Huterer, Dragan. Mon .
"Catastrophic photometric redshift errors: Weak-lensing survey requirements". United States. https://doi.org/10.1111/j.1365-2966.2009.15748.x. https://www.osti.gov/servlets/purl/1203553.
@article{osti_1203553,
title = {Catastrophic photometric redshift errors: Weak-lensing survey requirements},
author = {Bernstein, Gary and Huterer, Dragan},
abstractNote = {We study the sensitivity of weak lensing surveys to the effects of catastrophic redshift errors - cases where the true redshift is misestimated by a significant amount. To compute the biases in cosmological parameters, we adopt an efficient linearized analysis where the redshift errors are directly related to shifts in the weak lensing convergence power spectra. We estimate the number Nspec of unbiased spectroscopic redshifts needed to determine the catastrophic error rate well enough that biases in cosmological parameters are below statistical errors of weak lensing tomography. While the straightforward estimate of Nspec is ~106 we find that using only the photometric redshifts with z ≤ 2.5 leads to a drastic reduction in Nspec to ~ 30,000 while negligibly increasing statistical errors in dark energy parameters. Therefore, the size of spectroscopic survey needed to control catastrophic errors is similar to that previously deemed necessary to constrain the core of the zs – zp distribution. We also study the efficacy of the recent proposal to measure redshift errors by cross-correlation between the photo-z and spectroscopic samples. We find that this method requires ~ 10% a priori knowledge of the bias and stochasticity of the outlier population, and is also easily confounded by lensing magnification bias. In conclusion, the cross-correlation method is therefore unlikely to supplant the need for a complete spectroscopic redshift survey of the source population.},
doi = {10.1111/j.1365-2966.2009.15748.x},
journal = {Monthly Notices of the Royal Astronomical Society},
number = 2,
volume = 401,
place = {United States},
year = {Mon Jan 11 00:00:00 EST 2010},
month = {Mon Jan 11 00:00:00 EST 2010}
}
Free Publicly Available Full Text
Publisher's Version of Record
Other availability
Search WorldCat to find libraries that may hold this journal
Cited by: 88 works
Citation information provided by
Web of Science
Web of Science
Save to My Library
You must Sign In or Create an Account in order to save documents to your library.
Works referenced in this record:
Photometric redshifts for weak lensing tomography from space: the role of optical and near infrared photometry
journal, July 2008
- Abdalla, F. B.; Amara, A.; Capak, P.
- Monthly Notices of the Royal Astronomical Society, Vol. 387, Issue 3
Systematic bias in cosmic shear: extending the Fisher matrix
journal, November 2008
- Amara, Adam; Réfrégier, Alexandre
- Monthly Notices of the Royal Astronomical Society, Vol. 391, Issue 1
Photometric redshifts for the Dark Energy Survey and VISTA and implications for large-scale structure
journal, May 2008
- Banerji, Manda; Abdalla, Filipe B.; Lahav, Ofer
- Monthly Notices of the Royal Astronomical Society, Vol. 386, Issue 3
Weak gravitational lensing
journal, January 2001
- Bartelmann, Matthias; Schneider, Peter
- Physics Reports, Vol. 340, Issue 4-5
The Galaxy-Galaxy Lensing Contribution to the Cosmic Shear Two-Point Function
journal, January 2007
- Bridle, Sarah; Abdalla, Filipe B.
- The Astrophysical Journal, Vol. 655, Issue 1
Dark energy constraints from cosmic shear power spectra: impact of intrinsic alignments on photometric redshift requirements
journal, December 2007
- Bridle, Sarah; King, Lindsay
- New Journal of Physics, Vol. 9, Issue 12
Spin‐induced Galaxy Alignments and Their Implications for Weak‐Lensing Measurements
journal, October 2001
- Crittenden, Robert G.; Natarajan, Priyamvada; Pen, Ue‐Li
- The Astrophysical Journal, Vol. 559, Issue 2
Weak‐Lensing Surveys and the Intrinsic Correlation of Galaxy Ellipticities
journal, December 2000
- Croft, Rupert A. C.; Metzler, Christopher A.
- The Astrophysical Journal, Vol. 545, Issue 2
Estimating the redshift distribution of photometric galaxy samples - II. Applications and tests of a new method
journal, July 2009
- Cunha, Carlos E.; Lima, Marcos; Oyaizu, Hiroaki
- Monthly Notices of the Royal Astronomical Society, Vol. 396, Issue 4
Supernova Acceleration Probe: Investigating Photometric Redshift Optimization
journal, August 2008
- Dahlen, Tomas; Mobasher, Bahram; Jouvel, Stephanie
- The Astronomical Journal, Vol. 136, Issue 3
Inhomogeneous systematic signals in cosmic shear observations
journal, August 2005
- Guzik, Jacek; Bernstein, Gary
- Physical Review D, Vol. 72, Issue 4
Impact of Dark Matter Substructure on the Matter and Weak‐Lensing Power Spectra
journal, November 2005
- Hagan, Bradley; Ma, Chung‐Pei; Kravtsov, Andrey V.
- The Astrophysical Journal, Vol. 633, Issue 2
Intrinsic correlation of galaxy shapes: implications for weak lensing measurements
journal, December 2000
- Heavens, A.; Refregier, A.; Heymans, C.
- Monthly Notices of the Royal Astronomical Society, Vol. 319, Issue 2
Robustness of Cosmological Simulations. I. Large‐Scale Structure
journal, September 2005
- Heitmann, Katrin; Ricker, Paul M.; Warren, Michael S.
- The Astrophysical Journal Supplement Series, Vol. 160, Issue 1
Weak gravitational lensing: reducing the contamination by intrinsic alignments
journal, March 2003
- Heymans, C.; Heavens, A.
- Monthly Notices of the Royal Astronomical Society, Vol. 339, Issue 3
The Shear Testing Programme – I. Weak lensing analysis of simulated ground-based observations
journal, April 2006
- Heymans, Catherine; Van Waerbeke, Ludovic; Bacon, David
- Monthly Notices of the Royal Astronomical Society, Vol. 368, Issue 3
FIVE-YEAR WILKINSON MICROWAVE ANISOTROPY PROBE OBSERVATIONS: DATA PROCESSING, SKY MAPS, AND BASIC RESULTS
journal, February 2009
- Hinshaw, G.; Weiland, J. L.; Hill, R. S.
- The Astrophysical Journal Supplement Series, Vol. 180, Issue 2
Intrinsic alignment-lensing interference as a contaminant of cosmic shear
journal, September 2004
- Hirata, Christopher M.; Seljak, Uroš
- Physical Review D, Vol. 70, Issue 6
Galaxy-galaxy weak lensing in the Sloan Digital Sky Survey: intrinsic alignments and shear calibration errors
journal, September 2004
- Hirata, Christopher M.; Mandelbaum, Rachel; Seljak, Uroš
- Monthly Notices of the Royal Astronomical Society, Vol. 353, Issue 2
Weak Gravitational Lensing and Its Cosmological Applications
journal, November 2008
- Hoekstra, Henk; Jain, Bhuvnesh
- Annual Review of Nuclear and Particle Science, Vol. 58, Issue 1
Weak lensing and dark energy
journal, February 2002
- Huterer, Dragan
- Physical Review D, Vol. 65, Issue 6
Calibrating the nonlinear matter power spectrum: Requirements for future weak lensing surveys
journal, May 2005
- Huterer, D.; Takada, M.
- Astroparticle Physics, Vol. 23, Issue 4
Systematic errors in future weak-lensing surveys: requirements and prospects for self-calibration
journal, February 2006
- Huterer, D.; Takada, M.; Bernstein, G.
- Monthly Notices of the Royal Astronomical Society, Vol. 366, Issue 1
Probing dark energy: Methods and strategies
journal, November 2001
- Huterer, Dragan; Turner, Michael S.
- Physical Review D, Vol. 64, Issue 12
Nulling tomography with weak gravitational lensing
journal, August 2005
- Huterer, Dragan; White, Martin
- Physical Review D, Vol. 72, Issue 4
PSF anisotropy and systematic errors in weak lensing surveys
journal, February 2006
- Jain, Bhuvnesh; Jarvis, Mike; Bernstein, Gary
- Journal of Cosmology and Astroparticle Physics, Vol. 2006, Issue 02
Intrinsic correlation of halo ellipticity and its implications for large-scale weak lensing surveys
journal, October 2002
- Jing, Y. P.
- Monthly Notices of the Royal Astronomical Society, Vol. 335, Issue 4
The removal of shear-ellipticity correlations from the cosmic shear signal via nulling techniques
journal, July 2008
- Joachimi, B.; Schneider, P.
- Astronomy & Astrophysics, Vol. 488, Issue 3
Separating cosmic shear from intrinsic galaxy alignments: Correlation function tomography
journal, January 2003
- King, L. J.; Schneider, P.
- Astronomy & Astrophysics, Vol. 398, Issue 1
Systematic effects on dark energy from 3D weak shear
journal, September 2008
- Kitching, T. D.; Taylor, A. N.; Heavens, A. F.
- Monthly Notices of the Royal Astronomical Society, Vol. 389, Issue 1
Impact of Inhomogeneous Reionization on Cosmic Microwave Background Anisotropy
journal, September 1998
- Knox, Lloyd; Scoccimarro, Román; Dodelson, Scott
- Physical Review Letters, Vol. 81, Issue 10
Estimating the redshift distribution of photometric galaxy samples
journal, October 2008
- Lima, Marcos; Cunha, Carlos E.; Oyaizu, Hiroaki
- Monthly Notices of the Royal Astronomical Society, Vol. 390, Issue 1
Size of Spectroscopic Calibration Samples for Cosmic Shear Photometric Redshifts
journal, July 2008
- Ma, Zhaoming; Bernstein, Gary
- The Astrophysical Journal, Vol. 682, Issue 1
Diagnosing Space Telescope Misalignment and Jitter Using Stellar Images
journal, December 2008
- Ma, Zhaoming; Bernstein, Gary; Weinstein, Alan
- Publications of the Astronomical Society of the Pacific, Vol. 120, Issue 874
Effects of Photometric Redshift Uncertainties on Weak‐Lensing Tomography
journal, January 2006
- Ma, Zhaoming; Hu, Wayne; Huterer, Dragan
- The Astrophysical Journal, Vol. 636, Issue 1
Theoretical estimates of intrinsic galaxy alignment
journal, June 2002
- Mackey, J.; White, M.; Kamionkowski, M.
- Monthly Notices of the Royal Astronomical Society, Vol. 332, Issue 4
Detection of large-scale intrinsic ellipticity--density correlation from the Sloan Digital Sky Survey and implications for weak lensing surveys
journal, April 2006
- Mandelbaum, R.; Hirata, C. M.; Ishak, M.
- Monthly Notices of the Royal Astronomical Society, Vol. 367, Issue 2
Precision photometric redshift calibration for galaxy–galaxy weak lensing
journal, May 2008
- Mandelbaum, R.; Seljak, U.; Hirata, C. M.
- Monthly Notices of the Royal Astronomical Society, Vol. 386, Issue 2
The Shear Testing Programme 2: Factors affecting high-precision weak-lensing analyses
journal, March 2007
- Massey, Richard; Heymans, Catherine; Bergé, Joel
- Monthly Notices of the Royal Astronomical Society, Vol. 376, Issue 1
Cosmology with weak lensing surveys
journal, June 2008
- Munshi, D.; Valageas, P.; Vanwaerbeke, L.
- Physics Reports, Vol. 462, Issue 3
Photometric Redshift Error Estimators
journal, December 2008
- Oyaizu, Hiroaki; Lima, Marcos; Cunha, Carlos E.
- The Astrophysical Journal, Vol. 689, Issue 2
The clustering of luminous red galaxies in the Sloan Digital Sky Survey imaging data
journal, June 2007
- Padmanabhan, Nikhil; Schlegel, David J.; Seljak, Uroš
- Monthly Notices of the Royal Astronomical Society, Vol. 378, Issue 3
Point spread function calibration requirements for dark energy from cosmic shear
journal, March 2008
- Paulin-Henriksson, S.; Amara, A.; Voigt, L.
- Astronomy & Astrophysics, Vol. 484, Issue 1
Effects of Baryons and Dissipation on the Matter Power Spectrum
journal, January 2008
- Rudd, Douglas H.; Zentner, Andrew R.; Kravtsov, Andrey V.
- The Astrophysical Journal, Vol. 672, Issue 1
Biased dark Energy Constraints from Neglecting Reduced Shear in Weak-Lensing Surveys
journal, April 2009
- Shapiro, Charles
- The Astrophysical Journal, Vol. 696, Issue 1
The Born and lens–lens corrections to weak gravitational lensing angular power spectra
journal, March 2006
- Shapiro, Charles; Cooray, Asantha
- Journal of Cosmology and Astroparticle Physics, Vol. 2006, Issue 03
Using Galaxy Two‐Point Correlation Functions to Determine the Redshift Distributions of Galaxies Binned by Photometric Redshift
journal, November 2006
- Schneider, Michael; Knox, Lloyd; Zhan, Hu
- The Astrophysical Journal, Vol. 651, Issue 1
Probing dark energy with cluster counts and cosmic shear power spectra: including the full covariance
journal, December 2007
- Takada, Masahiro; Bridle, Sarah
- New Journal of Physics, Vol. 9, Issue 12
The impact of non-Gaussian errors on weak lensing surveys
journal, June 2009
- Takada, Masahiro; Jain, Bhuvnesh
- Monthly Notices of the Royal Astronomical Society, Vol. 395, Issue 4
Karhunen‐Loeve Eigenvalue Problems in Cosmology: How Should We Tackle Large Data Sets?
journal, May 1997
- Tegmark, Max; Taylor, Andy N.; Heavens, Alan F.
- The Astrophysical Journal, Vol. 480, Issue 1
Baryons and weak lensing power spectra
journal, November 2004
- White, Martin
- Astroparticle Physics, Vol. 22, Issue 2
Self-calibration of tomographic weak lensing for the physics of baryons to constrain dark energy
journal, February 2008
- Zentner, Andrew R.; Rudd, Douglas H.; Hu, Wayne
- Physical Review D, Vol. 77, Issue 4
Effect of Hot Baryons on the Weak-Lensing Shear Power Spectrum
journal, October 2004
- Zhan, Hu; Knox, Lloyd
- The Astrophysical Journal, Vol. 616, Issue 2
Expansion schemes for gravitational clustering: computing two-point and three-point functions
journal, April 2008
- Valageas, P.
- Astronomy & Astrophysics, Vol. 484, Issue 1
Works referencing / citing this record:
Cosmology with cosmic shear observations: a review
journal, July 2015
- Kilbinger, Martin
- Reports on Progress in Physics, Vol. 78, Issue 8
Cosmology with the Large Synoptic Survey Telescope: an overview
journal, April 2018
- Zhan, Hu; Anthony Tyson, J.
- Reports on Progress in Physics, Vol. 81, Issue 6
Testing the origin of the CMB large-angle correlation deficit with a galaxy imaging survey
journal, October 2011
- Hearin, Andrew P.; Gibelyou, Cameron; Zentner, Andrew R.
- Journal of Cosmology and Astroparticle Physics, Vol. 2011, Issue 10
General requirements on matter power spectrum predictions for cosmology with weak lensing tomography
journal, April 2012
- Hearin, Andrew P.; Zentner, Andrew R.; Ma, Zhaoming
- Journal of Cosmology and Astroparticle Physics, Vol. 2012, Issue 04
DESI and other Dark Energy experiments in the era of neutrino mass measurements
journal, May 2014
- Font-Ribera, Andreu; McDonald, Patrick; Mostek, Nick
- Journal of Cosmology and Astroparticle Physics, Vol. 2014, Issue 05
Constraining neutrino mass with the tomographic weak lensing bispectrum
journal, May 2019
- Coulton, William R.; Liu, Jia; Madhavacheril, Mathew S.
- Journal of Cosmology and Astroparticle Physics, Vol. 2019, Issue 05
Tests of Catastrophic Outlier Prediction in Empirical Photometric Redshift Estimation with Redshift Probability Distributions
journal, January 2020
- Jones, E.; Singal, J.
- Publications of the Astronomical Society of the Pacific, Vol. 132, Issue 1008
CFHTLenS tomographic weak lensing: quantifying accurate redshift distributions
journal, March 2013
- Benjamin, Jonathan; Van Waerbeke, Ludovic; Heymans, Catherine
- Monthly Notices of the Royal Astronomical Society, Vol. 431, Issue 2
On using angular cross-correlations to determine source redshift distributions
journal, July 2013
- McQuinn, M.; White, M.
- Monthly Notices of the Royal Astronomical Society, Vol. 433, Issue 4
Accounting for baryonic effects in cosmic shear tomography: determining a minimal set of nuisance parameters using PCA
journal, October 2015
- Eifler, Tim; Krause, Elisabeth; Dodelson, Scott
- Monthly Notices of the Royal Astronomical Society, Vol. 454, Issue 3
The impact of intrinsic alignment on current and future cosmic shear surveys
journal, December 2015
- Krause, Elisabeth; Eifler, Tim; Blazek, Jonathan
- Monthly Notices of the Royal Astronomical Society, Vol. 456, Issue 1
CFHTLenS revisited: assessing concordance with Planck including astrophysical systematics
journal, October 2016
- Joudaki, Shahab; Blake, Chris; Heymans, Catherine
- Monthly Notices of the Royal Astronomical Society, Vol. 465, Issue 2
An accurate and practical method for inference of weak gravitational lensing from galaxy images
journal, April 2016
- Bernstein, Gary M.; Armstrong, Robert; Krawiec, Christina
- Monthly Notices of the Royal Astronomical Society, Vol. 459, Issue 4
Improving photometric redshift estimation using GPz: size information, post processing, and improved photometry
journal, December 2017
- Gomes, Zahra; Jarvis, Matt J.; Almosallam, Ibrahim A.
- Monthly Notices of the Royal Astronomical Society, Vol. 475, Issue 1
Weak lensing magnification in the Dark Energy Survey Science Verification data
journal, February 2018
- Garcia-Fernandez, M.; Sanchez, E.; Sevilla-Noarbe, I.
- Monthly Notices of the Royal Astronomical Society, Vol. 476, Issue 1
Detecting baryon acoustic oscillations in dark matter from kinematic weak lensing surveys
journal, May 2019
- Ding, Zhejie; Seo, Hee-Jong; Huff, Eric
- Monthly Notices of the Royal Astronomical Society, Vol. 487, Issue 1
Estimating redshift distributions using hierarchical logistic Gaussian processes
journal, November 2019
- Rau, Markus Michael; Wilson, Simon; Mandelbaum, Rachel
- Monthly Notices of the Royal Astronomical Society, Vol. 491, Issue 4
Effects of unstable dark matter on large-scale structure and constraints from future surveys
journal, February 2012
- Wang, Mei-Yu; Zentner, Andrew R.
- Physical Review D, Vol. 85, Issue 4
Results of the GREAT08 Challenge★: an image analysis competition for cosmological lensing: Results of the GREAT08 Challenge
journal, May 2010
- Bridle, Sarah; Balan, Sreekumar T.; Bethge, Matthias
- Monthly Notices of the Royal Astronomical Society
Modelling the angular correlation function and its full covariance in photometric galaxy surveys: Angular clustering in photometric surveys
journal, March 2011
- Crocce, Martín; Cabré, Anna; Gaztañaga, Enrique
- Monthly Notices of the Royal Astronomical Society, Vol. 414, Issue 1
Sample variance in photometric redshift calibration: cosmological biases and survey requirements: Sample variance in photo-z calibration
journal, April 2012
- Cunha, Carlos E.; Huterer, Dragan; Busha, Michael T.
- Monthly Notices of the Royal Astronomical Society, Vol. 423, Issue 1
Cosmological Studies from Tomographic Weak Lensing Peak Abundances and Impacts of Photo- z Errors
journal, October 2019
- Yuan, Shuo; Pan, Chuzhong; Liu, Xiangkun
- The Astrophysical Journal, Vol. 884, Issue 2
Photometric Redshift Estimation with Galaxy Morphology Using Self-organizing Maps
journal, January 2020
- Wilson, Derek; Nayyeri, Hooshang; Cooray, Asantha
- The Astrophysical Journal, Vol. 888, Issue 2
SCUBA-2 Ultra Deep Imaging EAO Survey (Studies). III. Multiwavelength Properties, Luminosity Functions, and Preliminary Source Catalog of 450 μ m Selected Galaxies
journal, January 2020
- Lim, Chen-Fatt; Wang, Wei-Hao; Smail, Ian
- The Astrophysical Journal, Vol. 889, Issue 2
Results of the GREAT08 Challenge: An image analysis competition for cosmological lensing
text, January 2010
- Sarah, Bridle,; T., Balan, Sreekumar; Matthias, Bethge,
- ETH Zurich
Sample variance in photometric redshift calibration: cosmological biases and survey requirements
text, January 2012
- Cunha, Carlos E.; Huterer, Dragan; Busha, Michael T.
- Wiley-Blackwell
General Requirements on Matter Power Spectrum Predictions for Cosmology with Weak Lensing Tomography
text, January 2011
- Hearin, Andrew P.; Zentner, Andrew R.; Ma, Zhaoming
- arXiv
Effects of Unstable Dark Matter on Large-Scale Structure and Constraints from Future Surveys
text, January 2012
- Wang, Mei-Yu; Zentner, Andrew R.
- arXiv
On using angular cross-correlations to determine source redshift distributions
text, January 2013
- McQuinn, Matthew; White, Martin
- arXiv
DESI and other dark energy experiments in the era of neutrino mass measurements
text, January 2013
- Font-Ribera, Andreu; McDonald, Patrick; Mostek, Nick
- arXiv
The impact of intrinsic alignment on current and future cosmic shear surveys
text, January 2015
- Krause, Elisabeth; Eifler, Tim; Blazek, Jonathan
- arXiv
An accurate and practical method for inference of weak gravitational lensing from galaxy images
text, January 2015
- Bernstein, Gary M.; Armstrong, Robert; Krawiec, Christina
- arXiv
CFHTLenS revisited: assessing concordance with Planck including astrophysical systematics
text, January 2016
- Joudaki, Shahab; Blake, Chris; Heymans, Catherine
- arXiv
Cosmological studies from tomographic weak lensing peak abundances and impacts of photo-z errors
text, January 2019
- Yuan, Shuo; Pan, Chuzhong; Liu, Xiangkun
- arXiv