DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: What’s the Difference? The Potential for Convolutional Neural Networks for Transient Detection without Template Subtraction

Abstract

Abstract We present a study of the potential for convolutional neural networks (CNNs) to enable separation of astrophysical transients from image artifacts, a task known as “real–bogus” classification, without requiring a template-subtracted (or difference) image, which requires a computationally expensive process to generate, involving image matching on small spatial scales in large volumes of data. Using data from the Dark Energy Survey, we explore the use of CNNs to (1) automate the real–bogus classification and (2) reduce the computational costs of transient discovery. We compare the efficiency of two CNNs with similar architectures, one that uses “image triplets” (templates, search, and difference image) and one that takes as input the template and search only. We measure the decrease in efficiency associated with the loss of information in input, finding that the testing accuracy is reduced from ∼96% to ∼91.1%. We further investigate how the latter model learns the required information from the template and search by exploring the saliency maps. Our work (1) confirms that CNNs are excellent models for real–bogus classification that rely exclusively on the imaging data and require no feature engineering task and (2) demonstrates that high-accuracy (>90%) models can be built without the need to constructmore » difference images, but some accuracy is lost. Because, once trained, neural networks can generate predictions at minimal computational costs, we argue that future implementations of this methodology could dramatically reduce the computational costs in the detection of transients in synoptic surveys like Rubin Observatory's Legacy Survey of Space and Time by bypassing the difference image analysis entirely.« less

Authors:
ORCiD logo; ORCiD logo; ORCiD logo; ORCiD logo; ORCiD logo;
Publication Date:
Sponsoring Org.:
USDOE
OSTI Identifier:
1995913
Grant/Contract Number:  
FOA-0002424
Resource Type:
Published Article
Journal Name:
The Astronomical Journal
Additional Journal Information:
Journal Name: The Astronomical Journal Journal Volume: 166 Journal Issue: 3; Journal ID: ISSN 0004-6256
Publisher:
American Astronomical Society
Country of Publication:
United States
Language:
English

Citation Formats

Acero-Cuellar, Tatiana, Bianco, Federica, Dobler, Gregory, Sako, Masao, Qu, Helen, and The LSST Dark Energy Science Collaboration. What’s the Difference? The Potential for Convolutional Neural Networks for Transient Detection without Template Subtraction. United States: N. p., 2023. Web. doi:10.3847/1538-3881/ace9d8.
Acero-Cuellar, Tatiana, Bianco, Federica, Dobler, Gregory, Sako, Masao, Qu, Helen, & The LSST Dark Energy Science Collaboration. What’s the Difference? The Potential for Convolutional Neural Networks for Transient Detection without Template Subtraction. United States. https://doi.org/10.3847/1538-3881/ace9d8
Acero-Cuellar, Tatiana, Bianco, Federica, Dobler, Gregory, Sako, Masao, Qu, Helen, and The LSST Dark Energy Science Collaboration. Fri . "What’s the Difference? The Potential for Convolutional Neural Networks for Transient Detection without Template Subtraction". United States. https://doi.org/10.3847/1538-3881/ace9d8.
@article{osti_1995913,
title = {What’s the Difference? The Potential for Convolutional Neural Networks for Transient Detection without Template Subtraction},
author = {Acero-Cuellar, Tatiana and Bianco, Federica and Dobler, Gregory and Sako, Masao and Qu, Helen and The LSST Dark Energy Science Collaboration},
abstractNote = {Abstract We present a study of the potential for convolutional neural networks (CNNs) to enable separation of astrophysical transients from image artifacts, a task known as “real–bogus” classification, without requiring a template-subtracted (or difference) image, which requires a computationally expensive process to generate, involving image matching on small spatial scales in large volumes of data. Using data from the Dark Energy Survey, we explore the use of CNNs to (1) automate the real–bogus classification and (2) reduce the computational costs of transient discovery. We compare the efficiency of two CNNs with similar architectures, one that uses “image triplets” (templates, search, and difference image) and one that takes as input the template and search only. We measure the decrease in efficiency associated with the loss of information in input, finding that the testing accuracy is reduced from ∼96% to ∼91.1%. We further investigate how the latter model learns the required information from the template and search by exploring the saliency maps. Our work (1) confirms that CNNs are excellent models for real–bogus classification that rely exclusively on the imaging data and require no feature engineering task and (2) demonstrates that high-accuracy (>90%) models can be built without the need to construct difference images, but some accuracy is lost. Because, once trained, neural networks can generate predictions at minimal computational costs, we argue that future implementations of this methodology could dramatically reduce the computational costs in the detection of transients in synoptic surveys like Rubin Observatory's Legacy Survey of Space and Time by bypassing the difference image analysis entirely.},
doi = {10.3847/1538-3881/ace9d8},
journal = {The Astronomical Journal},
number = 3,
volume = 166,
place = {United States},
year = {Fri Aug 18 00:00:00 EDT 2023},
month = {Fri Aug 18 00:00:00 EDT 2023}
}

Journal Article:
Free Publicly Available Full Text
Publisher's Version of Record
https://doi.org/10.3847/1538-3881/ace9d8

Save / Share:

Works referenced in this record:

Astropy: A community Python package for astronomy
journal, September 2013


How to COAAD Images. II. A Coaddition Image that is Optimal for Any Purpose in the Background-dominated Noise Limit
journal, February 2017


Rotation-invariant convolutional neural networks for galaxy morphology prediction
journal, April 2015

  • Dieleman, Sander; Willett, Kyle W.; Dambre, Joni
  • Monthly Notices of the Royal Astronomical Society, Vol. 450, Issue 2
  • DOI: 10.1093/mnras/stv632

The Astropy Project: Building an Open-science Project and Status of the v2.0 Core Package
journal, August 2018

  • Price-Whelan, A. M.; Sipőcz, B. M.; Günther, H. M.
  • The Astronomical Journal, Vol. 156, Issue 3
  • DOI: 10.3847/1538-3881/aabc4f

Deep learning
journal, May 2015

  • LeCun, Yann; Bengio, Yoshua; Hinton, Geoffrey
  • Nature, Vol. 521, Issue 7553
  • DOI: 10.1038/nature14539

Deep Learning for Image Sequence Classification of Astronomical Events
journal, September 2019

  • Carrasco-Davis, Rodrigo; Cabrera-Vives, Guillermo; Förster, Francisco
  • Publications of the Astronomical Society of the Pacific, Vol. 131, Issue 1004
  • DOI: 10.1088/1538-3873/aaef12

Convolutional neural networks for transient candidate vetting in large-scale surveys
journal, August 2017

  • Gieseke, Fabian; Bloemen, Steven; van den Bogaard, Cas
  • Monthly Notices of the Royal Astronomical Society, Vol. 472, Issue 3
  • DOI: 10.1093/mnras/stx2161

Real-bogus classification for the Zwicky Transient Facility using deep learning
journal, August 2019

  • Duev, Dmitry A.; Mahabal, Ashish; Masci, Frank J.
  • Monthly Notices of the Royal Astronomical Society
  • DOI: 10.1093/mnras/stz2357

The Difference Imaging Pipeline for the Transient Search in the dark Energy Survey
journal, November 2015


Alert Classification for the ALeRCE Broker System: The Real-time Stamp Classifier
journal, November 2021

  • Carrasco-Davis, R.; Reyes, E.; Valenzuela, C.
  • The Astronomical Journal, Vol. 162, Issue 6
  • DOI: 10.3847/1538-3881/ac0ef1

Machine Learning for the Zwicky Transient Facility
journal, January 2019

  • Mahabal, Ashish; Rebbapragada, Umaa; Walters, Richard
  • Publications of the Astronomical Society of the Pacific, Vol. 131, Issue 997
  • DOI: 10.1088/1538-3873/aaf3fa

Expanding the Realm of Microlensing Surveys with Difference Image Photometry
journal, December 1996

  • Tomaney, Austin B.; Crotts, Arlin P. S.
  • The Astronomical Journal, Vol. 112
  • DOI: 10.1086/118228

The Zwicky Transient Facility: System Overview, Performance, and First Results
journal, December 2018

  • Bellm, Eric C.; Kulkarni, Shrinivas R.; Graham, Matthew J.
  • Publications of the Astronomical Society of the Pacific, Vol. 131, Issue 995
  • DOI: 10.1088/1538-3873/aaecbe

Machine learning for transient recognition in difference imaging with minimum sampling effort
journal, October 2020

  • Mong, Y-L; Ackley, K.; Galloway, D. K.
  • Monthly Notices of the Royal Astronomical Society, Vol. 499, Issue 4
  • DOI: 10.1093/mnras/staa3096

LSST: From Science Drivers to Reference Design and Anticipated Data Products
journal, March 2019

  • Ivezić, Željko; Kahn, Steven M.; Tyson, J. Anthony
  • The Astrophysical Journal, Vol. 873, Issue 2
  • DOI: 10.3847/1538-4357/ab042c

Effective image differencing with convolutional neural networks for real-time transient hunting
journal, April 2018

  • Sedaghat, Nima; Mahabal, Ashish
  • Monthly Notices of the Royal Astronomical Society, Vol. 476, Issue 4
  • DOI: 10.1093/mnras/sty613

Automated Transient Identification in the dark Energy Survey
journal, August 2015


Array programming with NumPy
journal, September 2020

  • Harris, Charles R.; Millman, K. Jarrod; van der Walt, Stéfan J.
  • Nature, Vol. 585, Issue 7825
  • DOI: 10.1038/s41586-020-2649-2

Detecting optical transients using artificial neural networks and reference images from different surveys
journal, July 2021

  • Wardęga, Katarzyna; Zadrożny, Adam; Beroiz, Martin
  • Monthly Notices of the Royal Astronomical Society, Vol. 507, Issue 2
  • DOI: 10.1093/mnras/stab2163

A Method for Optimal Image Subtraction
journal, August 1998

  • Alard, C.; Lupton, Robert H.
  • The Astrophysical Journal, Vol. 503, Issue 1
  • DOI: 10.1086/305984

NN-SVG: Publication-Ready Neural Network Architecture Schematics
journal, January 2019


The high Cadence Transient Survey (Hits). i. Survey Design and Supernova Shock Breakout Constraints
journal, November 2016


Matplotlib: A 2D Graphics Environment
journal, January 2007


Comparison of LSST and DECam wavefront recovery algorithms
conference, July 2016

  • Xin, Bo; Roodman, Aaron; Angeli, George
  • SPIE Astronomical Telescopes + Instrumentation, SPIE Proceedings
  • DOI: 10.1117/12.2234456

Deep-HiTS: Rotation Invariant Convolutional Neural Network for Transient Detection
journal, February 2017

  • Cabrera-Vives, Guillermo; Reyes, Ignacio; Förster, Francisco
  • The Astrophysical Journal, Vol. 836, Issue 1
  • DOI: 10.3847/1538-4357/836/1/97

Machine learning on difference image analysis: A comparison of methods for transient detection
journal, July 2019


The Dark Energy Survey: Data Release 1
journal, November 2018

  • Abbott, T. M. C.; Abdalla, F. B.; Allam, S.
  • The Astrophysical Journal Supplement Series, Vol. 239, Issue 2
  • DOI: 10.3847/1538-4365/aae9f0

A deep learning approach for detecting candidates of supernova remnants
journal, March 2019


seaborn: statistical data visualization
journal, April 2021


The 2.5 m Telescope of the Sloan Digital Sky Survey
journal, April 2006

  • Gunn, James E.; Siegmund, Walter A.; Mannery, Edward J.
  • The Astronomical Journal, Vol. 131, Issue 4
  • DOI: 10.1086/500975

Automating Discovery and Classification of Transients and Variable Stars in the Synoptic Survey Era
journal, November 2012

  • Bloom, J. S.; Richards, J. W.; Nugent, P. E.
  • Publications of the Astronomical Society of the Pacific, Vol. 124, Issue 921
  • DOI: 10.1086/668468

M31 - A unique laboratory for gravitational microlensing
journal, November 1992

  • Crotts, Arlin P. S.
  • The Astrophysical Journal, Vol. 399
  • DOI: 10.1086/186602

Star–galaxy classification using deep convolutional neural networks
journal, October 2016

  • Kim, Edward J.; Brunner, Robert J.
  • Monthly Notices of the Royal Astronomical Society, Vol. 464, Issue 4
  • DOI: 10.1093/mnras/stw2672