DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: The Zwicky Transient Facility Bright Transient Survey. III. BTSbot: Automated Identification and Follow-up of Bright Transients with Deep Learning

Journal Article · · The Astrophysical Journal
ORCiD logo; ORCiD logo; ORCiD logo; ORCiD logo; ORCiD logo; ORCiD logo; ORCiD logo; ORCiD logo; ORCiD logo; ORCiD logo; ORCiD logo; ORCiD logo; ORCiD logo

Abstract The Bright Transient Survey (BTS) aims to obtain a classification spectrum for all bright ( m peak ≤ 18.5 mag) extragalactic transients found in the Zwicky Transient Facility (ZTF) public survey. BTS critically relies on visual inspection (“scanning”) to select targets for spectroscopic follow-up, which, while effective, has required a significant time investment over the past ∼5 yr of ZTF operations. We present BTSbot , a multimodal convolutional neural network, which provides a bright transient score to individual ZTF detections using their image data and 25 extracted features. BTSbot is able to eliminate the need for daily human scanning by automatically identifying and requesting spectroscopic follow-up observations of new bright transient candidates. BTSbot recovers all bright transients in our test split and performs on par with scanners in terms of identification speed (on average, ∼1 hr quicker than scanners). We also find that BTSbot is not significantly impacted by any data shift by comparing performance across a concealed test split and a sample of very recent BTS candidates. BTSbot has been integrated into Fritz and Kowalski , ZTF’s first-party marshal and alert broker, and now sends automatic spectroscopic follow-up requests for the new transients it identifies. Between 2023 December and 2024 May, BTSbot selected 609 sources in real time, 96% of which were real extragalactic transients. With BTSbot and other automation tools, the BTS workflow has produced the first fully automatic end-to-end discovery and classification of a transient, representing a significant reduction in the human time needed to scan.

Sponsoring Organization:
USDOE
OSTI ID:
2476576
Journal Information:
The Astrophysical Journal, Journal Name: The Astrophysical Journal Journal Issue: 1 Vol. 972; ISSN 0004-637X
Publisher:
American Astronomical SocietyCopyright Statement
Country of Publication:
United States
Language:
English

References (89)

A logical calculus of the ideas immanent in nervous activity journal December 1943
Neocognitron: A new algorithm for pattern recognition tolerant of deformations and shifts in position journal January 1982
Random Forests journal January 2001
Deep learning journal May 2015
Author Correction: Uncovering a population of gravitational lens galaxies with magnified standard candle SN Zwicky journal June 2023
Array programming with NumPy journal September 2020
The complex circumstellar environment of supernova 2023ixf journal March 2024
SciPy 1.0: fundamental algorithms for scientific computing in Python journal February 2020
Astropy: A community Python package for astronomy journal September 2013
Photometric redshifts from SDSS images using a convolutional neural network journal December 2018
Fully automated integral field spectrograph pipeline for the SEDMachine: pysedm journal July 2019
Transient processing and analysis using AMPEL: alert management, photometry, and evaluation of light curves journal November 2019
A low-energy explosion yields the underluminous Type IIP SN 2020cxd journal November 2021
Maximum luminosities of normal stripped-envelope supernovae are brighter than explosion models allow journal January 2022
SNGuess: A method for the selection of young extragalactic transients journal September 2022
Cosmic rate of type IIn supernovae and its evolution with redshift journal February 2023
AutoSourceID-Classifier journal December 2023
How to Find More Supernovae with Less Work: Object Classification Techniques for Difference Imaging journal August 2007
An Early Warning System for Asteroid Impact journal January 2011
Automating Discovery and Classification of Transients and Variable Stars in the Synoptic Survey Era
  • Bloom, J. S.; Richards, J. W.; Nugent, P. E.
  • Publications of the Astronomical Society of the Pacific, Vol. 124, Issue 921 https://doi.org/10.1086/668468
journal November 2012
Automated Transient Identification in the dark Energy Survey journal August 2015
The man Behind the Curtain: X-Rays Drive the uv Through nir Variability in the 2013 Active Galactic Nucleus Outburst in ngc 2617 journal May 2014
ANNz2: Photometric Redshift and Probability Distribution Function Estimation using Machine Learning journal August 2016
The SED Machine: A Robotic Spectrograph for Fast Transient Classification journal February 2018
ATLAS: A High-cadence All-sky Survey System journal May 2018
A Morphological Classification Model to Identify Unresolved PanSTARRS1 Sources: Application in the ZTF Real-time Pipeline journal November 2018
The Zwicky Transient Facility: Data Processing, Products, and Archive journal December 2018
The Zwicky Transient Facility Alert Distribution System journal November 2018
The Zwicky Transient Facility: System Overview, Performance, and First Results journal December 2018
Machine Learning for the Zwicky Transient Facility journal January 2019
The GROWTH Marshal: A Dynamic Science Portal for Time-domain Astronomy journal February 2019
The Zwicky Transient Facility: Science Objectives journal May 2019
The Zwicky Transient Facility: Surveys and Scheduler journal April 2019
RAPID: Early Classification of Explosive Transients Using Deep Learning journal September 2019
The Zwicky Transient Facility: Observing System journal January 2020
Design and Operation of the ATLAS Transient Science Server journal June 2020
New Modules for the SEDMachine to Remove Contaminations from Cosmic Rays and Non-target Light: byecr and contsep journal February 2022
Vetting the optical transient candidates detected by the GWAC network using convolutional neural networks journal July 2020
The ZTF-BTS Type Ia supernovae luminosity function is consistent with a single progenitor channel for the explosions journal November 2021
The large-scale environment of thermonuclear and core-collapse supernovae journal December 2021
Transient-optimized real-bogus classification with Bayesian convolutional neural networks – sifting the GOTO candidate stream journal March 2021
Using machine learning for discovery in synoptic survey imaging data journal August 2013
TPZ: photometric redshift PDFs and ancillary information by using prediction trees and random forests journal May 2013
Machine learning for transient discovery in Pan-STARRS1 difference imaging journal March 2015
Rotation-invariant convolutional neural networks for galaxy morphology prediction journal April 2015
CMU DeepLens: deep learning for automatic image-based galaxy–galaxy strong lens finding journal July 2017
Identification of low surface brightness tidal features in galaxies using convolutional neural networks journal November 2018
Improving galaxy morphologies for SDSS with Deep Learning journal February 2018
Real-bogus classification for the Zwicky Transient Facility using deep learning journal August 2019
Galaxy Zoo: probabilistic morphology through Bayesian CNNs and active learning journal October 2019
SuperNNova: an open-source framework for Bayesian, neural network-based supernova classification journal December 2019
Matplotlib: A 2D Graphics Environment journal January 2007
Pan-STARRS: A Large Synoptic Survey Telescope Array conference December 2002
The Million Quasars (Milliquas) Catalogue, v8 journal December 2023
corner.py: Scatterplot matrices in Python journal June 2016
SkyPortal: An Astronomical Data Platform journal May 2019
tqdm: A Fast, Extensible Progress Meter for Python and CLI journal May 2019
Data Structures for Statistical Computing in Python conference January 2010
The Astropy Project: Building an Open-science Project and Status of the v2.0 Core Package journal August 2018
Avocado: Photometric Classification of Astronomical Transients with Gaussian Process Augmentation journal December 2019
The ZTF Source Classification Project. I. Methods and Infrastructure journal May 2021
The Automatic Learning for the Rapid Classification of Events (ALeRCE) Alert Broker journal April 2021
SCONE: Supernova Classification with a Convolutional Neural Network journal July 2021
Alert Classification for the ALeRCE Broker System: The Real-time Stamp Classifier journal November 2021
Deep-HiTS: Rotation Invariant Convolutional Neural Network for Transient Detection journal February 2017
LSST: From Science Drivers to Reference Design and Anticipated Data Products journal March 2019
Census of the Local Universe (CLU) Narrowband Survey. I. Galaxy Catalogs from Preliminary Fields journal July 2019
Supernova Photometric Classification Pipelines Trained on Spectroscopically Classified Supernovae from the Pan-STARRS1 Medium-deep Survey journal October 2019
The Zwicky Transient Facility Bright Transient Survey. I. Spectroscopic Classification and the Redshift Completeness of Local Galaxy Catalogs journal May 2020
The Zwicky Transient Facility Bright Transient Survey. II. A Public Statistical Sample for Exploring Supernova Demographics journal November 2020
FLEET: A Redshift-agnostic Machine Learning Pipeline to Rapidly Identify Hydrogen-poor Superluminous Supernovae journal November 2020
Photometric Classification of 2315 Pan-STARRS1 Supernovae with Superphot journal December 2020
SuperRAENN: A Semisupervised Supernova Photometric Classification Pipeline Trained on Pan-STARRS1 Medium-Deep Survey Supernovae journal December 2020
Less Than 1% of Core-collapse Supernovae in the Local Universe Occur in Elliptical Galaxies journal March 2022
DeepZipper: A Novel Deep-learning Architecture for Lensed Supernovae Identification journal March 2022
DeepZipper. II. Searching for Lensed Supernovae in Dark Energy Survey Data with Deep Learning journal January 2023
The Astropy Project: Sustaining and Growing a Community-oriented Open-source Project and the Latest Major Release (v5.0) of the Core Package* journal August 2022
A Systematic Study of Ia-CSM Supernovae from the ZTF Bright Transient Survey journal May 2023
Identifying Tidal Disruption Events with an Expansion of the FLEET Machine-learning Algorithm journal June 2023
The Iron Yield of Core-collapse Supernovae journal September 2023
A Data Science Platform to Enable Time-domain Astronomy journal July 2023
SNIascore: Deep-learning Classification of Low-resolution Supernova Spectra journal August 2021
Multiscale Stamps for Real-time Classification of Alert Streams journal August 2023
From Discovery to the First Month of the Type II Supernova 2023ixf: High and Variable Mass Loss in the Final Year before Explosion journal September 2023
SN 2023ixf in Messier 101: Photo-ionization of Dense, Close-in Circumstellar Material in a Nearby Type II Supernova journal September 2023
Early Spectroscopy and Dense Circumstellar Medium Interaction in SN 2023ixf journal October 2023
tdescore: An Accurate Photometric Classifier for Tidal Disruption Events journal April 2024
BTSbot v10 training set dataset January 2024
pandas-dev/pandas: Pandas software January 2024

Similar Records

Related Subjects