DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Photometric redshifts from SDSS images with an interpretable deep capsule network

Journal Article · · Monthly Notices of the Royal Astronomical Society

ABSTRACT Studies of cosmology, galaxy evolution, and astronomical transients with current and next-generation wide-field imaging surveys like the Rubin Observatory Legacy Survey of Space and Time are all critically dependent on estimates of photometric redshifts. Capsule networks are a new type of neural network architecture that is better suited for identifying morphological features of the input images than traditional convolutional neural networks. We use a deep capsule network trained on ugriz images, spectroscopic redshifts, and Galaxy Zoo spiral/elliptical classifications of ∼400 000 Sloan Digital Sky Survey galaxies to do photometric redshift estimation. We achieve a photometric redshift prediction accuracy and a fraction of catastrophic outliers that are comparable to or better than current methods for SDSS main galaxy sample-like data sets (r ≤ 17.8 and zspec ≤ 0.4) while requiring less data and fewer trainable parameters. Furthermore, the decision-making of our capsule network is much more easily interpretable as capsules act as a low-dimensional encoding of the image. When the capsules are projected on a two-dimensional manifold, they form a single redshift sequence with the fraction of spirals in a region exhibiting a gradient roughly perpendicular to the redshift sequence. We perturb encodings of real galaxy images in this low-dimensional space to create synthetic galaxy images that demonstrate the image properties (e.g. size, orientation, and surface brightness) encoded by each dimension. We also measure correlations between galaxy properties (e.g. magnitudes, colours, and stellar mass) and each capsule dimension. We publicly release our code, estimated redshifts, and additional catalogues at https://biprateep.github.io/encapZulate-1.

Research Organization:
Argonne National Laboratory (ANL), Lemont, IL (United States); Lawrence Berkeley National Laboratory (LBNL), Berkeley, CA (United States)
Sponsoring Organization:
National Aeronautics and Space Administration (NASA); National Science Foundation (NSF); USDOE Office of Science (SC), High Energy Physics (HEP)
Grant/Contract Number:
AC02-05CH11231; AC02-06CH11357
OSTI ID:
1882234
Journal Information:
Monthly Notices of the Royal Astronomical Society, Journal Name: Monthly Notices of the Royal Astronomical Society Journal Issue: 4 Vol. 515; ISSN 0035-8711
Publisher:
Oxford University PressCopyright Statement
Country of Publication:
United Kingdom
Language:
English

References (101)

Neural Networks for Photometric Redshifts Evaluation book January 2003
Transforming Auto-Encoders book January 2011
Self-organized formation of topologically correct feature maps journal January 1982
Approximation by superpositions of a sigmoidal function journal December 1989
Neocognitron: A new algorithm for pattern recognition tolerant of deformations and shifts in position journal January 1982
Multilayer feedforward networks are universal approximators journal January 1989
Approximation capabilities of multilayer feedforward networks journal January 1991
Measuring photometric redshifts using galaxy images and Deep Neural Networks journal July 2016
Conditional density estimation tools in python and R with applications to photometric redshifts and likelihood-free cosmological inference journal January 2020
Learning representations by back-propagating errors journal October 1986
Deep learning journal May 2015
The many flavours of photometric redshifts journal June 2018
Array programming with NumPy journal September 2020
SciPy 1.0: fundamental algorithms for scientific computing in Python journal February 2020
Measuring and modelling the redshift evolution of clustering: the Hubble Deep Field North journal December 1999
Estimating photometric redshifts with artificial neural networks journal March 2003
Stellar masses and star formation histories for 10 5 galaxies from the Sloan Digital Sky Survey journal May 2003
PHAT: PHoto- z Accuracy Testing journal November 2010
Astropy: A community Python package for astronomy journal September 2013
Analysis of a custom support vector machine for photometric redshift estimation and the inclusion of galaxy shape information journal April 2017
Photometric redshift estimation via deep learning: Generalized and pre-classification-less, image based, fully probabilistic redshifts journal January 2018
Return of the features: Efficient feature selection and interpretation for photometric redshifts⋆ journal August 2018
Photometric redshifts from SDSS images using a convolutional neural network journal December 2018
Photometric redshift calibration with self-organising maps journal April 2020
Euclid preparation: X. The Euclid photometric-redshift challenge journal November 2020
Photometric selection and redshifts for quasars in the Kilo-Degree Survey Data Release 4 journal May 2021
Photometric redshift estimation with a convolutional neural network: NetZ journal July 2021
Accurate photometric redshifts for the CFHT legacy survey calibrated using the VIMOS VLT deep survey journal September 2006
A relation between distance and radial velocity among extra-galactic nebulae journal March 1929
Slicing Through Multicolor Space: Galaxy Redshifts from Broadband Photometry journal December 1995
Observational Evidence from Supernovae for an Accelerating Universe and a Cosmological Constant journal September 1998
The Sloan Digital Sky Survey Photometric Camera journal December 1998
The Sloan Digital Sky Survey: Technical Summary journal September 2000
Maps of Dust Infrared Emission for Use in Estimation of Reddening and Cosmic Microwave Background Radiation Foregrounds journal June 1998
Measurements of Ω and Λ from 42 High‐Redshift Supernovae journal June 1999
Bayesian Photometric Redshift Estimation journal June 2000
ANN z : Estimating Photometric Redshifts Using Artificial Neural Networks journal April 2004
The Origin of the Mass‐Metallicity Relation: Insights from 53,000 Star‐forming Galaxies in the Sloan Digital Sky Survey journal October 2004
Estimating Photometric Redshifts Using Support Vector Machines journal January 2005
New York University Value-Added Galaxy Catalog: A Galaxy Catalog Based on New Public Surveys journal June 2005
Detection of the Baryon Acoustic Peak in the Large‐Scale Correlation Function of SDSS Luminous Red Galaxies journal November 2005
The 2.5 m Telescope of the Sloan Digital Sky Survey journal April 2006
An Improved Photometric Calibration of the Sloan Digital Sky Survey Imaging Data journal February 2008
Robust Machine Learning Applied to Astronomical Data Sets. III. Probabilistic Photometric Redshifts for Galaxies and Quasars in the SDSS and GALEX journal August 2008
EAZY: A Fast, Public Photometric Redshift Code journal October 2008
Improved Background Subtraction for the Sloan Digital sky Survey Images journal June 2011
The Multi-Object, Fiber-Fed Spectrographs for the Sloan Digital sky Survey and the Baryon Oscillation Spectroscopic Survey journal July 2013
COSMOS PHOTOMETRIC REDSHIFTS WITH 30-BANDS FOR 2-deg 2 journal December 2008
New Approaches to Photometric Redshift Prediction via Gaussian Process Regression in the Sloan Digital sky Survey journal November 2009
Random Forests for Photometric Redshifts journal March 2010
Mapping the Galaxy Color–Redshift Relation: Optimal Photometric Redshift Calibration Strategies for Cosmology Surveys journal October 2015
The Eighth data Release of the Sloan Digital sky Survey: First data from Sdss-Iii journal March 2011
Candels: the Cosmic Assembly Near-Infrared deep Extragalactic Legacy Survey journal December 2011
CANDELS: THE COSMIC ASSEMBLY NEAR-INFRARED DEEP EXTRAGALACTIC LEGACY SURVEY—THE HUBBLE SPACE TELESCOPE OBSERVATIONS, IMAGING DATA PRODUCTS, AND MOSAICS journal December 2011
THE SLOAN DIGITAL SKY SURVEY STRIPE 82 IMAGING DATA: DEPTH-OPTIMIZED CO-ADDS OVER 300 deg 2 IN FIVE FILTERS journal June 2014
The Eleventh and Twelfth data Releases of the Sloan Digital sky Survey: Final data from Sdss-Iii journal July 2015
Improved photometric redshifts with colour-constrained galaxy templates for future wide-area surveys journal July 2020
Evaluation of probabilistic photometric redshift estimation approaches for The Rubin Observatory Legacy Survey of Space and Time (LSST) journal September 2020
The Clustering of DESI-like Luminous Red Galaxies Using Photometric Redshifts journal December 2020
Dark Energy Survey Year 3 results: redshift calibration of the weak lensing source galaxies journal May 2021
Improving the reliability of photometric redshift with machine learning journal August 2021
Photometric redshift estimation of BASS DR3 quasars by machine learning journal November 2021
Deep learning methods for obtaining photometric redshift estimations from images journal February 2022
SOMz: photometric redshift PDFs with self-organizing maps and random atlas journal January 2014
Photometric redshifts for the SDSS Data Release 12 journal April 2016
GPz: non-stationary sparse Gaussian processes for heteroscedastic uncertainty estimation in photometric redshifts journal July 2016
METAPHOR: a machine-learning-based method for the probability density estimation of photometric redshifts journal November 2016
Improving photometric redshift estimation using GPz: size information, post processing, and improved photometry journal December 2017
Statistical analysis of probability density functions for photometric redshifts through the KiDS-ESO-DR3 galaxies journal October 2018
Galaxy morphology prediction using Capsule Networks journal April 2019
Extragalactic science, cosmology, and Galactic archaeology with the Subaru Prime Focus Spectrograph journal February 2014
Gradient-based learning applied to document recognition journal January 1998
Unsupervised Learning of Invariant Feature Hierarchies with Applications to Object Recognition conference June 2007
Going deeper with convolutions conference June 2015
Rethinking the Inception Architecture for Computer Vision conference June 2016
Deep Residual Learning for Image Recognition conference June 2016
Matplotlib: A 2D Graphics Environment journal January 2007
The physical properties of star-forming galaxies in the low-redshift Universe journal July 2004
The 2dF Galaxy Redshift Survey: power-spectrum analysis of the final data set and cosmological implications journal September 2005
The Zurich Extragalactic Bayesian Redshift Analyzer and its first application: COSMOS journal October 2006
Photometric redshifts with surface brightness priors journal July 2008
Photometric redshift estimation using spectral connectivity analysis journal October 2009
Galaxy Zoo 1: data release of morphological classifications for nearly 900 000 galaxies★: Galaxy Zoo journal November 2010
Unsupervised self-organized mapping: a versatile empirical tool for object selection, classification and redshift estimation in large surveys: Self-organization for surveys journal November 2011
Convolutional deep belief networks for scalable unsupervised learning of hierarchical representations conference January 2009
Transforming classifier scores into accurate multiclass probability estimates conference January 2002
Backpropagation Applied to Handwritten Zip Code Recognition journal December 1989
Measuring and testing dependence by correlation of distances journal December 2007
A Value for n-Person Games book December 1953
UMAP: Uniform Manifold Approximation and Projection journal September 2018
seaborn: statistical data visualization journal April 2021
Data Structures for Statistical Computing in Python conference January 2010
Photometric Redshifts with the LSST: Evaluating Survey Observing Strategies journal January 2018
The Astropy Project: Building an Open-science Project and Status of the v2.0 Core Package journal August 2018
Overview of the DESI Legacy Imaging Surveys journal April 2019
The SAGA Survey. I. Satellite Galaxy Populations around Eight Milky Way Analogs journal September 2017
The Complete Calibration of the Color–Redshift Relation (C3R2) Survey: Analysis and Data Release 2 journal May 2019
MAGPHYS+photo-z: Constraining the Physical Properties of Galaxies with Unknown Redshifts journal September 2019
The SAGA Survey. II. Building a Statistical Sample of Satellite Systems around Milky Way–like Galaxies journal February 2021
Multi-messenger Observations of a Binary Neutron Star Merger journal October 2017
pandas-dev/pandas: Pandas software January 2024

Similar Records

GALAXY ZOO MORPHOLOGY AND PHOTOMETRIC REDSHIFTS IN THE SLOAN DIGITAL SKY SURVEY
Journal Article · 2011 · Astrophysical Journal Letters · OSTI ID:21562620

Estimating cluster masses from SDSS multiband images with transfer learning
Journal Article · 2022 · Monthly Notices of the Royal Astronomical Society · OSTI ID:1861456

Improved Tomographic Binning of 3 × 2 pt Lens Samples: Neural Network Classifiers and Optimal Bin Assignments
Journal Article · 2023 · The Astrophysical Journal · OSTI ID:1984711