Skip to main content
U.S. Department of Energy
Office of Scientific and Technical Information

DeepMerge – II. Building robust deep learning algorithms for merging galaxy identification across domains

Journal Article · · Monthly Notices of the Royal Astronomical Society

ABSTRACT

In astronomy, neural networks are often trained on simulation data with the prospect of being used on telescope observations. Unfortunately, training a model on simulation data and then applying it to instrument data leads to a substantial and potentially even detrimental decrease in model accuracy on the new target data set. Simulated and instrument data represent different data domains, and for an algorithm to work in both, domain-invariant learning is necessary. Here, we employ domain adaptation techniques – Maximum Mean Discrepancy as an additional transfer loss and Domain Adversarial Neural Networks – and demonstrate their viability to extract domain-invariant features within the astronomical context of classifying merging and non-merging galaxies. Additionally, we explore the use of Fisher loss and entropy minimization to enforce better in-domain class discriminability. We show that the addition of each domain adaptation technique improves the performance of a classifier when compared to conventional deep learning algorithms. We demonstrate this on two examples: between two Illustris-1 simulated data sets of distant merging galaxies, and between Illustris-1 simulated data of nearby merging galaxies and observed data from the Sloan Digital Sky Survey. The use of domain adaptation techniques in our experiments leads to an increase of target domain classification accuracy of up to $${\sim }20{{\ \rm per\ cent}}$$. With further development, these techniques will allow astronomers to successfully implement neural network models trained on simulation data to efficiently detect and study astrophysical objects in current and future large-scale astronomical surveys.

Sponsoring Organization:
USDOE
Grant/Contract Number:
AC02-06CH11357
OSTI ID:
1807592
Alternate ID(s):
OSTI ID: 1840563
OSTI ID: 1780598
Journal Information:
Monthly Notices of the Royal Astronomical Society, Journal Name: Monthly Notices of the Royal Astronomical Society Journal Issue: 1 Vol. 506; ISSN 0035-8711
Publisher:
Oxford University PressCopyright Statement
Country of Publication:
United Kingdom
Language:
English

References (42)

A Mathematical Theory of Communication journal July 1948
Deep CORAL: Correlation Alignment for Deep Domain Adaptation book January 2016
Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization journal October 2019
DeepMerge: Classifying high-redshift merging galaxies with deep neural networks journal July 2020
Deep visual domain adaptation: A survey journal October 2018
Identifying galaxy mergers in observations and simulations with deep learning journal June 2019
Bars formed in galaxy merging and their classification with deep learning journal September 2020
Towards a consistent framework of comparing galaxy mergers in observations and simulations journal December 2020
A Direct Measurement of Major Galaxy Mergers at z 3 journal September 2003
A New Nonparametric Approach to Galaxy Morphological Classification journal July 2004
The DEEP2 Galaxy Redshift Survey: Evolution of Close Galaxy Pairs and Major-Merger Rates up to z ~ 1.2 journal November 2004
Stellar masses of giant clumps in CANDELS and simulated galaxies using machine learning journal September 2020
The nature of giant clumps in high- z discs: a deep-learning comparison of simulations and observations journal December 2020
Introducing the Illustris Project: simulating the coevolution of dark and visible matter in the Universe journal August 2014
The EAGLE project: simulating the evolution and assembly of galaxies and their environments journal November 2014
Galaxy morphology and star formation in the Illustris Simulation at z  = 0 journal October 2015
Simulating galaxy formation with the IllustrisTNG model journal October 2017
First results from the IllustrisTNG simulations: the galaxy colour bimodality journal November 2017
First results from the IllustrisTNG simulations: matter and galaxy clustering journal December 2017
Using transfer learning to detect galaxy mergers journal May 2018
Automated distant galaxy merger classifications from Space Telescope images using the Illustris simulation journal April 2019
Deep learning predictions of galaxy merger stage and the importance of observational realism journal October 2019
ImageNet: A large-scale hierarchical image database
  • Deng, Jia; Dong, Wei; Socher, Richard
  • 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPR Workshops), 2009 IEEE Conference on Computer Vision and Pattern Recognition https://doi.org/10.1109/CVPR.2009.5206848
conference June 2009
Deep Residual Learning for Image Recognition conference June 2016
Contrastive Adaptation Network for Unsupervised Domain Adaptation conference June 2019
DeepHyper: Asynchronous Hyperparameter Search for Deep Neural Networks conference December 2018
Domain Adaptation via Transfer Component Analysis journal February 2011
Scatter Component Analysis: A Unified Framework for Domain Adaptation and Domain Generalization journal July 2017
The hierarchical formation of the brightest cluster galaxies journal February 2007
The high-redshift galaxy population in hierarchical galaxy formation models journal March 2007
Galaxy Zoo: morphologies derived from visual inspection of galaxies from the Sloan Digital Sky Survey journal September 2008
Galaxy Zoo: the fraction of merging galaxies in the SDSS and their morphologies journal January 2010
Galaxy Zoo 1: data release of morphological classifications for nearly 900 000 galaxies★: Galaxy Zoo journal November 2010
GAMA: towards a physical understanding of galaxy formation journal October 2009
Scalable reinforcement-learning-based neural architecture search for cancer deep learning research
  • Balaprakash, Prasanna; Egele, Romain; Salim, Misha
  • SC '19: The International Conference for High Performance Computing, Networking, Storage, and Analysis, Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis https://doi.org/10.1145/3295500.3356202
conference November 2019
A Survey of Unsupervised Deep Domain Adaptation journal September 2020
Cosmic Star-Formation History journal August 2014
The IllustrisTNG simulations: public data release journal May 2019
On Information and Sufficiency journal March 1951
How to Use t-SNE Effectively journal October 2016
Deep Learning Identifies High- z Galaxies in a Central Blue Nugget Phase in a Characteristic Mass Range journal May 2018
Galaxy Merger Rates up to z ∼ 3 Using a Bayesian Deep Learning Model: A Major-merger Classifier Using IllustrisTNG Simulation Data journal June 2020

Similar Records

DeepMerge – II. Building robust deep learning algorithms for merging galaxy identification across domains
Journal Article · Wed Sep 01 00:00:00 EDT 2021 · Monthly Notices of the Royal Astronomical Society · OSTI ID:1840563

DeepMerge: Classifying high-redshift merging galaxies with deep neural networks
Journal Article · Sat May 16 00:00:00 EDT 2020 · Astronomy and Computing · OSTI ID:1632199

Related Subjects