Skip to main content
U.S. Department of Energy
Office of Scientific and Technical Information

DeepMerge – II. Building robust deep learning algorithms for merging galaxy identification across domains

Journal Article · · Monthly Notices of the Royal Astronomical Society

In astronomy, neural networks are often trained on simulation data with the prospect of being used on telescope observations. Unfortunately, training a model on simulation data and then applying it to instrument data leads to a substantial and potentially even detrimental decrease in model accuracy on the new target dataset. Simulated and instrument data represent different data domains, and for an algorithm to work in both, domain-invariant learning is necessary. Here we employ domain adaptation techniques— Maximum Mean Discrepancy (MMD) as an additional transfer loss and Domain Adversarial Neural Networks (DANNs)— and demonstrate their viability to extract domain-invariant features within the astronomical context of classifying merging and non-merging galaxies. Additionally, we explore the use of Fisher loss and entropy minimization to enforce better in-domain class discriminability. We show that the addition of each domain adaptation technique improves the performance of a classifier when compared to conventional deep learning algorithms. We demonstrate this on two examples: between two Illustris-1 simulated datasets of distant merging galaxies, and between Illustris-1 simulated data of nearby merging galaxies and observed data from the Sloan Digital Sky Survey. The use of domain adaptation techniques in our experiments leads to an increase of target domain classification accuracy of up to ~20%. With further development, these techniques will allow astronomers to successfully implement neural network models trained on simulation data to efficiently detect and study astrophysical objects in current and future large-scale astronomical surveys.

Research Organization:
Argonne National Laboratory (ANL)
Sponsoring Organization:
Argonne National Laboratory - Argonne Leadership Computing Facility; USDOE Office of Science - Office of High Energy Physics; Fermi Research Alliance, LLC
DOE Contract Number:
AC02-06CH11357
OSTI ID:
1840563
Journal Information:
Monthly Notices of the Royal Astronomical Society, Journal Name: Monthly Notices of the Royal Astronomical Society Journal Issue: 1 Vol. 506; ISSN 0035-8711
Publisher:
Royal Astronomical Society
Country of Publication:
United States
Language:
English

References (42)

Introducing the Illustris Project: simulating the coevolution of dark and visible matter in the Universe journal August 2014
On Information and Sufficiency journal March 1951
The nature of giant clumps in high- z discs: a deep-learning comparison of simulations and observations journal December 2020
Simulating galaxy formation with the IllustrisTNG model journal October 2017
Galaxy Merger Rates up to z ∼ 3 Using a Bayesian Deep Learning Model: A Major-merger Classifier Using IllustrisTNG Simulation Data journal June 2020
Cosmic Star-Formation History journal August 2014
Using transfer learning to detect galaxy mergers journal May 2018
ImageNet: A large-scale hierarchical image database
  • Deng, Jia; Dong, Wei; Socher, Richard
  • 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPR Workshops), 2009 IEEE Conference on Computer Vision and Pattern Recognition https://doi.org/10.1109/CVPR.2009.5206848
conference June 2009
Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization journal October 2019
Galaxy Zoo: morphologies derived from visual inspection of galaxies from the Sloan Digital Sky Survey journal September 2008
Stellar masses of giant clumps in CANDELS and simulated galaxies using machine learning journal September 2020
Deep visual domain adaptation: A survey journal October 2018
Contrastive Adaptation Network for Unsupervised Domain Adaptation conference June 2019
A Survey of Unsupervised Deep Domain Adaptation journal September 2020
First results from the IllustrisTNG simulations: matter and galaxy clustering journal December 2017
Scatter Component Analysis: A Unified Framework for Domain Adaptation and Domain Generalization journal July 2017
Deep Residual Learning for Image Recognition conference June 2016
Bars formed in galaxy merging and their classification with deep learning journal September 2020
A Mathematical Theory of Communication journal July 1948
The IllustrisTNG simulations: public data release journal May 2019
Domain Adaptation via Transfer Component Analysis journal February 2011
How to Use t-SNE Effectively journal October 2016
Galaxy Zoo 1: data release of morphological classifications for nearly 900 000 galaxies★: Galaxy Zoo journal November 2010
Identifying galaxy mergers in observations and simulations with deep learning journal June 2019
The high-redshift galaxy population in hierarchical galaxy formation models journal March 2007
DeepMerge: Classifying high-redshift merging galaxies with deep neural networks journal July 2020
The DEEP2 Galaxy Redshift Survey: Evolution of Close Galaxy Pairs and Major-Merger Rates up to z ~ 1.2 journal November 2004
The EAGLE project: simulating the evolution and assembly of galaxies and their environments journal November 2014
Galaxy morphology and star formation in the Illustris Simulation at z  = 0 journal October 2015
A New Nonparametric Approach to Galaxy Morphological Classification journal July 2004
Deep learning predictions of galaxy merger stage and the importance of observational realism journal October 2019
Galaxy Zoo: the fraction of merging galaxies in the SDSS and their morphologies journal January 2010
GAMA: towards a physical understanding of galaxy formation journal October 2009
A Direct Measurement of Major Galaxy Mergers at z 3 journal September 2003
Deep CORAL: Correlation Alignment for Deep Domain Adaptation book January 2016
First results from the IllustrisTNG simulations: the galaxy colour bimodality journal November 2017
DeepHyper: Asynchronous Hyperparameter Search for Deep Neural Networks conference December 2018
Deep Learning Identifies High- z Galaxies in a Central Blue Nugget Phase in a Characteristic Mass Range journal May 2018
Automated distant galaxy merger classifications from Space Telescope images using the Illustris simulation journal April 2019
Towards a consistent framework of comparing galaxy mergers in observations and simulations journal December 2020
Scalable reinforcement-learning-based neural architecture search for cancer deep learning research
  • Balaprakash, Prasanna; Egele, Romain; Salim, Misha
  • SC '19: The International Conference for High Performance Computing, Networking, Storage, and Analysis, Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis https://doi.org/10.1145/3295500.3356202
conference November 2019
The hierarchical formation of the brightest cluster galaxies journal February 2007

Cited By (1)

DeepGhostBusters: Using Mask R-CNN to detect and mask ghosting and scattered-light artifacts from optical survey images journal April 2022

Similar Records

DeepMerge – II. Building robust deep learning algorithms for merging galaxy identification across domains
Journal Article · Fri Jun 11 00:00:00 EDT 2021 · Monthly Notices of the Royal Astronomical Society · OSTI ID:1807592

Domain adaptation techniques for improved cross-domain study of galaxy mergers
Conference · Thu Nov 05 23:00:00 EST 2020 · OSTI ID:1767041