skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: DES science portal: Computing photometric redshifts

Journal Article · · Astronomy and Computing
; ; ; ; ; ; ; ; ORCiD logo; ; ; ; ; ORCiD logo; ORCiD logo; ; ; ; ; more »; ; ; ; ORCiD logo; ; ; ; ; ; ORCiD logo; ORCiD logo; ; ; ; ; ORCiD logo; ORCiD logo; ; ; ; ; ; ; ; ; ; ; ; ORCiD logo; ; ; ; ORCiD logo; ; ORCiD logo; ; ; ; ; ; ; ORCiD logo; ORCiD logo; ; ; ; ; ORCiD logo; ORCiD logo; ; « less

We report that a significant challenge facing photometric surveys for cosmological purposes is the need to produce reliable redshift estimates. The estimation of photometric redshifts (photo-zs) has been consolidated as the standard strategy to bypass the high production costs and incompleteness of spectroscopic redshift samples. Training-based photo-z methods require the preparation of a high-quality list of spectroscopic redshifts, which needs to be constantly updated. The photo-z training, validation, and estimation must be performed in a consistent and reproducible way in order to accomplish the scientific requirements. To meet this purpose, we developed an integrated web-based data interface that not only provides the framework to carry out the above steps in a systematic way, enabling the ease testing and comparison of different algorithms, but also addresses the processing requirements by parallelizing the calculation in a transparent way for the user. This framework called the Science Portal (hereafter Portal) was developed in the context the Dark Energy Survey (DES) to facilitate scientific analysis. In this paper, we show how the Portal can provide a reliable environment to access vast datasets, provide validation algorithms and metrics, even in the case of multiple photo-zs methods. It is possible to maintain the provenance between the steps of a chain of workflows while ensuring reproducibility of the results. We illustrate how the Portal can be used to provide photo-z estimates using the DES first year (Y1A1) data. Finally, while the DES collaboration is still developing techniques to obtain more precise photo-zs, having a structured framework like the one presented here is critical for the systematic vetting of DES algorithmic improvements and the consistent production of photo-zs in future DES releases.

Research Organization:
Fermi National Accelerator Laboratory (FNAL), Batavia, IL (United States); Oak Ridge National Laboratory (ORNL), Oak Ridge, TN (United States)
Sponsoring Organization:
USDOE Office of Science (SC), High Energy Physics (HEP); USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR)
Contributing Organization:
DES; DES Collaboration
Grant/Contract Number:
AC02-07CH11359; AC05-00OR22725
OSTI ID:
1362048
Alternate ID(s):
OSTI ID: 1479703; OSTI ID: 1637158
Report Number(s):
arXiv:1708.05643; DES-2016-0175; FERMILAB-PUB-17-043; 1654411
Journal Information:
Astronomy and Computing, Vol. 25, Issue C; ISSN 2213-1337
Publisher:
ElsevierCopyright Statement
Country of Publication:
United States
Language:
English
Citation Metrics:
Cited by: 14 works
Citation information provided by
Web of Science

References (72)

Measuring the redshift evolution of clustering: the Hubble Deep Field South journal January 2002
Combining Dark Energy Survey Science Verification data with near-infrared data from the ESO VISTA Hemisphere Survey journal November 2014
Spt-Gmos: a Gemini/Gmos-South Spectroscopic Survey of Galaxy Clusters in the Spt-Sz Survey journal November 2016
Photometric selection of Type Ia supernovae in the Supernova Legacy Survey journal September 2011
Bayesian Photometric Redshift Estimation journal June 2000
The 2-degree Field Lensing Survey: design and clustering measurements journal August 2016
Redshift distributions of galaxies in the Dark Energy Survey Science Verification shear catalogue and implications for weak lensing journal August 2016
The 10 Meter South Pole Telescope
  • Carlstrom, J. E.; Ade, P. A. R.; Aird, K. A.
  • Publications of the Astronomical Society of the Pacific, Vol. 123, Issue 903 https://doi.org/10.1086/659879
journal May 2011
TPZ: photometric redshift PDFs and ancillary information by using prediction trees and random forests journal May 2013
Photometric redshift estimation based on data mining with PhotoRApToR journal February 2015
OzDES multifibre spectroscopy for the Dark Energy Survey: 3-yr results and first data release journal July 2017
The Prism Multi-Object Survey (Primus). i. Survey Overview and Characteristics journal October 2011
The 2dF Galaxy Redshift Survey: spectra and redshifts journal December 2001
ANN z : Estimating Photometric Redshifts Using Artificial Neural Networks journal April 2004
The Prism Multi-Object Survey (Primus). ii. data Reduction and Redshift Fitting journal April 2013
The Arizona CDFS Environment Survey (ACES): A Magellan/IMACS Spectroscopic Survey of the Chandra Deep Field-South: Arizona CDFS Environment Survey (ACES) journal August 2012
Spectroscopic failures in photometric redshift calibration: cosmological biases and survey requirements journal August 2014
Estimating the redshift distribution of photometric galaxy samples - II. Applications and tests of a new method journal July 2009
The All-Wavelength Extended Groth Strip International Survey (AEGIS) Data Sets journal April 2007
DNF – Galaxy photometric redshift by Directional Neighbourhood Fitting journal April 2016
The Dark Energy Survey: more than dark energy – an overview journal March 2016
The Blanco Cosmology Survey: data Acquisition, Processing, Calibration, Quality Diagnostics, and data Release journal September 2012
Galaxy and Mass Assembly (GAMA): survey diagnostics and core data release: GAMA journal March 2011
Dark Energy Survey Year 1 Results: The Photometric Data Set for Cosmology journal April 2018
DES science portal: Creating science-ready catalogs journal July 2018
The Dark Energy Survey journal June 2005
The dark Energy Camera journal October 2015
The VIMOS Public Extragalactic Survey (VIPERS): First Data Release of 57 204 spectroscopic measurements journal January 2014
The Vimos VLT deep survey: Global properties of 20 000 galaxies in the journal June 2008
Dark Energy Survey Year 1 results: cross-correlation redshifts – methods and systematics characterization journal February 2018
The SAGA Survey. I. Satellite Galaxy Populations around Eight Milky Way Analogs journal September 2017
Large-scale clustering measurements with photometric redshifts: comparing the dark matter haloes of X-ray AGN, star-forming and passive galaxies at z ≈ 1 journal August 2014
ArborZ: PHOTOMETRIC REDSHIFTS USING BOOSTED DECISION TREES journal May 2010
SkyNet: an efficient and robust neural network training tool for machine learning in astronomy journal May 2014
A General Study of the Influence of Catastrophic Photometric Redshift Errors on Cosmology with Cosmic Shear Tomography journal August 2010
Stellar Locus Regression: Accurate Color Calibration and the Real-Time Determination of Galaxy Cluster Photometric Redshifts journal May 2009
PHAT: PHoto- z Accuracy Testing journal November 2010
Data augmentation for machine learning redshifts applied to Sloan Digital Sky Survey galaxies journal April 2015
Redshift Accuracy Requirements for Future Supernova and Number Count Surveys journal November 2004
Accurate photometric redshifts for the CFHT legacy survey calibrated using the VIMOS VLT deep survey journal September 2006
THE SLOAN DIGITAL SKY SURVEY STRIPE 82 IMAGING DATA: DEPTH-OPTIMIZED CO-ADDS OVER 300 deg 2 IN FIVE FILTERS journal June 2014
The 6dF Galaxy Survey: final redshift release (DR3) and southern large-scale structures journal October 2009
The Difference Imaging Pipeline for the Transient Search in the dark Energy Survey journal November 2015
The VIMOS VLT deep survey: First epoch VVDS-deep survey: 11 564 spectra with 17.5  journal August 2005
The VIMOS VLT Deep Survey: Public release of 1599 redshifts to journal December 2004
The XXL Survey XIV. AAOmega Redshifts for the Southern XXL Field journal January 2016
An Efficient Approach to Obtaining Large Numbers of Distant Supernova Host Galaxy Redshifts journal January 2013
THE zCOSMOS 10k-BRIGHT SPECTROSCOPIC SAMPLE journal September 2009
Estimating the redshift distribution of photometric galaxy samples journal October 2008
Photometric redshift requirements for self-calibration of cluster dark energy studies journal December 2007
Size of Spectroscopic Calibration Samples for Cosmic Shear Photometric Redshifts journal July 2008
Effects of Photometric Redshift Uncertainties on Weak‐Lensing Tomography journal January 2006
The Australia Telescope Large Area Survey: spectroscopic catalogue and radio luminosity functions: ATLAS spectroscopic catalogue and RLFs journal October 2012
The Complete Calibration of the Color–Redshift Relation (C3R2) Survey: Survey Overview and Data Release 1 journal May 2017
THE 3D-HST SURVEY: HUBBLE SPACE TELESCOPE WFC3/G141 GRISM SPECTRA, REDSHIFTS, AND EMISSION LINE MEASUREMENTS FOR ∼100,000 GALAXIES journal August 2016
THE GEMINI CLUSTER ASTROPHYSICS SPECTROSCOPIC SURVEY (GCLASS): THE ROLE OF ENVIRONMENT AND SELF-REGULATION IN GALAXY EVOLUTION AT z ∼ 1 journal February 2012
ZFIRE: A KECK/MOSFIRE SPECTROSCOPIC SURVEY OF GALAXIES IN RICH ENVIRONMENTS AT z ∼ 2 journal August 2016
Calibrating Redshift Distributions beyond Spectroscopic Limits with Cross‐Correlations journal September 2008
Observation and Confirmation of six Strong-Lensing Systems in the dark Energy Survey Science Verification data journal August 2016
The WiggleZ Dark Energy Survey: Final data release and cosmological results journal November 2012
COSMOLOGICAL CONSTRAINTS FROM MEASUREMENTS OF TYPE Ia SUPERNOVAE DISCOVERED DURING THE FIRST 1.5 yr OF THE Pan-STARRS1 SURVEY journal October 2014
ANNz2: Photometric Redshift and Probability Distribution Function Estimation using Machine Learning journal August 2016
Photometric redshift analysis in the Dark Energy Survey Science Verification data journal October 2014
SYSTEMATIC UNCERTAINTIES ASSOCIATED WITH THE COSMOLOGICAL ANALYSIS OF THE FIRST PAN-STARRS1 TYPE Ia SUPERNOVA SAMPLE journal October 2014
COSMOS: Hubble Space Telescope Observations journal September 2007
THE FMOS-COSMOS SURVEY OF STAR-FORMING GALAXIES AT z ∼ 1.6. III. SURVEY DESIGN, PERFORMANCE, AND SAMPLE CHARACTERISTICS journal September 2015
Optical identification of XMM sources in the Canada–France–Hawaii Telescope Legacy Survey journal January 2010
The VIMOS Ultra Deep Survey first data release: Spectra and spectroscopic redshifts of 698 objects up to z spec ~ 6 in CANDELS journal April 2017
The Grism Lens-Amplified Survey from Space (Glass). i. Survey Overview and First data Release journal October 2015
OzDES multifibre spectroscopy for the Dark Energy Survey: first-year operation and results journal July 2015
The Las Campanas Redshift Survey journal October 1996
CMB lensing tomography with the DES Science Verification galaxies journal January 2016