DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Photometric classification of Hyper Suprime-Cam transients using machine learning

Abstract

Abstract The advancement of technology has resulted in a rapid increase in supernova (SN) discoveries. The Subaru/Hyper Suprime-Cam (HSC) transient survey, conducted from fall 2016 through spring 2017, yielded 1824 SN candidates. This gave rise to the need for fast type classification for spectroscopic follow-up and prompted us to develop a machine learning algorithm using a deep neural network with highway layers. This algorithm is trained by actual observed cadence and filter combinations such that we can directly input the observed data array without any interpretation. We tested our model with a dataset from the LSST classification challenge (Deep Drilling Field). Our classifier scores an area under the curve (AUC) of 0.996 for binary classification (SN Ia or non-SN Ia) and 95.3% accuracy for three-class classification (SN Ia, SN Ibc, or SN II). Application of our binary classification to HSC transient data yields an AUC score of 0.925. With two weeks of HSC data since the first detection, this classifier achieves 78.1% accuracy for binary classification, and the accuracy increases to 84.2% with the full dataset. This paper discusses the potential use of machine learning for SN type classification purposes.

Authors:
; ORCiD logo; ; ; ; ORCiD logo; ORCiD logo;
Publication Date:
Sponsoring Org.:
USDOE
OSTI Identifier:
1657872
Resource Type:
Published Article
Journal Name:
Publications of the Astronomical Society of Japan
Additional Journal Information:
Journal Name: Publications of the Astronomical Society of Japan Journal Volume: 72 Journal Issue: 5; Journal ID: ISSN 0004-6264
Publisher:
Oxford University Press
Country of Publication:
Japan
Language:
English

Citation Formats

Takahashi, Ichiro, Suzuki, Nao, Yasuda, Naoki, Kimura, Akisato, Ueda, Naonori, Tanaka, Masaomi, Tominaga, Nozomu, and Yoshida, Naoki. Photometric classification of Hyper Suprime-Cam transients using machine learning. Japan: N. p., 2020. Web. doi:10.1093/pasj/psaa082.
Takahashi, Ichiro, Suzuki, Nao, Yasuda, Naoki, Kimura, Akisato, Ueda, Naonori, Tanaka, Masaomi, Tominaga, Nozomu, & Yoshida, Naoki. Photometric classification of Hyper Suprime-Cam transients using machine learning. Japan. https://doi.org/10.1093/pasj/psaa082
Takahashi, Ichiro, Suzuki, Nao, Yasuda, Naoki, Kimura, Akisato, Ueda, Naonori, Tanaka, Masaomi, Tominaga, Nozomu, and Yoshida, Naoki. Fri . "Photometric classification of Hyper Suprime-Cam transients using machine learning". Japan. https://doi.org/10.1093/pasj/psaa082.
@article{osti_1657872,
title = {Photometric classification of Hyper Suprime-Cam transients using machine learning},
author = {Takahashi, Ichiro and Suzuki, Nao and Yasuda, Naoki and Kimura, Akisato and Ueda, Naonori and Tanaka, Masaomi and Tominaga, Nozomu and Yoshida, Naoki},
abstractNote = {Abstract The advancement of technology has resulted in a rapid increase in supernova (SN) discoveries. The Subaru/Hyper Suprime-Cam (HSC) transient survey, conducted from fall 2016 through spring 2017, yielded 1824 SN candidates. This gave rise to the need for fast type classification for spectroscopic follow-up and prompted us to develop a machine learning algorithm using a deep neural network with highway layers. This algorithm is trained by actual observed cadence and filter combinations such that we can directly input the observed data array without any interpretation. We tested our model with a dataset from the LSST classification challenge (Deep Drilling Field). Our classifier scores an area under the curve (AUC) of 0.996 for binary classification (SN Ia or non-SN Ia) and 95.3% accuracy for three-class classification (SN Ia, SN Ibc, or SN II). Application of our binary classification to HSC transient data yields an AUC score of 0.925. With two weeks of HSC data since the first detection, this classifier achieves 78.1% accuracy for binary classification, and the accuracy increases to 84.2% with the full dataset. This paper discusses the potential use of machine learning for SN type classification purposes.},
doi = {10.1093/pasj/psaa082},
journal = {Publications of the Astronomical Society of Japan},
number = 5,
volume = 72,
place = {Japan},
year = {Fri Sep 04 00:00:00 EDT 2020},
month = {Fri Sep 04 00:00:00 EDT 2020}
}

Journal Article:
Free Publicly Available Full Text
Publisher's Version of Record
https://doi.org/10.1093/pasj/psaa082

Save / Share:

Works referenced in this record:

Application of convolutional neural networks for stellar spectral classification
journal, November 2019

  • Sharma, Kaushal; Kembhavi, Ajit; Kembhavi, Aniruddha
  • Monthly Notices of the Royal Astronomical Society, Vol. 491, Issue 2
  • DOI: 10.1093/mnras/stz3100

Optical Spectra of Supernovae
journal, September 1997


First Release of High-redshift Superluminous Supernovae from the Subaru HIgh-Z SUpernova CAmpaign (SHIZUCA). II. Spectroscopic Properties
journal, March 2019

  • Curtin, Chris; Cooke, Jeff; Moriya, Takashi J.
  • The Astrophysical Journal Supplement Series, Vol. 241, Issue 2
  • DOI: 10.3847/1538-4365/ab07c8

Type Ia Supernovae in the First Few Days: Signatures of Helium Detonation versus Interaction
journal, July 2018

  • Maeda, Keiichi; Jiang, Ji-an; Shigeyama, Toshikazu
  • The Astrophysical Journal, Vol. 861, Issue 2
  • DOI: 10.3847/1538-4357/aac8d8

First Release of High-Redshift Superluminous Supernovae from the Subaru HIgh- Z SUpernova CAmpaign (SHIZUCA). I. Photometric Properties
journal, March 2019

  • Moriya, Takashi J.; Tanaka, Masaomi; Yasuda, Naoki
  • The Astrophysical Journal Supplement Series, Vol. 241, Issue 2
  • DOI: 10.3847/1538-4365/ab07c5

The relative specific Type Ia supernovae rate from three years of ASAS-SN
journal, January 2019

  • Brown, J. S.; Stanek, K. Z.; Holoien, T. W-S
  • Monthly Notices of the Royal Astronomical Society, Vol. 484, Issue 3
  • DOI: 10.1093/mnras/stz258

The delay of shock breakout due to circumstellar material evident in most type II supernovae
journal, September 2018


The Prism Multi-Object Survey (Primus). i. Survey Overview and Characteristics
journal, October 2011

  • Coil, Alison L.; Blanton, Michael R.; Burles, Scott M.
  • The Astrophysical Journal, Vol. 741, Issue 1
  • DOI: 10.1088/0004-637X/741/1/8

The Gemini–North Multi‐Object Spectrograph: Performance in Imaging, Long‐Slit, and Multi‐Object Spectroscopic Modes
journal, May 2004

  • Hook, I. M.; Jørgensen, Inger; Allington‐Smith, J. R.
  • Publications of the Astronomical Society of the Pacific, Vol. 116, Issue 819
  • DOI: 10.1086/383624

Accurate abundance patterns of solar twins and analogs: Does the anomalous solar chemical composition come from planet formation?
journal, November 2009


R-band light-curve properties of Type Ia supernovae from the (intermediate) Palomar Transient Factory
journal, December 2018

  • Papadogiannakis, S.; Goobar, A.; Amanullah, R.
  • Monthly Notices of the Royal Astronomical Society, Vol. 483, Issue 4
  • DOI: 10.1093/mnras/sty3301

PHOTOMETRIC REDSHIFT AND CLASSIFICATION FOR THE XMM -COSMOS SOURCES
journal, December 2008


THE FMOS-COSMOS SURVEY OF STAR-FORMING GALAXIES AT z ∼ 1.6. III. SURVEY DESIGN, PERFORMANCE, AND SAMPLE CHARACTERISTICS
journal, September 2015

  • Silverman, J. D.; Kashino, D.; Sanders, D.
  • The Astrophysical Journal Supplement Series, Vol. 220, Issue 1
  • DOI: 10.1088/0067-0049/220/1/12

Superluminous Supernovae
journal, March 2018

  • Moriya, Takashi J.; Sorokina, Elena I.; Chevalier, Roger A.
  • Space Science Reviews, Vol. 214, Issue 2
  • DOI: 10.1007/s11214-018-0493-6

Evolutionary population synthesis: models, analysis of the ingredients and application to high-z galaxies
journal, September 2005


The Cosmic Energy Inventory
journal, December 2004

  • Fukugita, Masataka; Peebles, P. J. E.
  • The Astrophysical Journal, Vol. 616, Issue 2
  • DOI: 10.1086/425155

Hyper Suprime-Cam: Filters
journal, June 2018

  • Kawanomoto, Satoshi; Uraguchi, Fumihiro; Komiyama, Yutaka
  • Publications of the Astronomical Society of Japan, Vol. 70, Issue 4
  • DOI: 10.1093/pasj/psy056

Photometric redshifts from SDSS images using a convolutional neural network
journal, December 2018


Measuring type ia Supernova Populations of Stretch and Color and Predicting Distance Biases
journal, May 2016


Automated Transient Identification in the dark Energy Survey
journal, August 2015


Avocado: Photometric Classification of Astronomical Transients with Gaussian Process Augmentation
journal, December 2019


The DEIMOS 10K Spectroscopic Survey Catalog of the COSMOS Field
journal, May 2018


The Keck Low-Resolution Imaging Spectrometer
journal, April 1995

  • Oke, J. B.; Cohen, J. G.; Carr, M.
  • Publications of the Astronomical Society of the Pacific, Vol. 107
  • DOI: 10.1086/133562

Observational Evidence from Supernovae for an Accelerating Universe and a Cosmological Constant
journal, September 1998

  • Riess, Adam G.; Filippenko, Alexei V.; Challis, Peter
  • The Astronomical Journal, Vol. 116, Issue 3
  • DOI: 10.1086/300499

Models and Simulations for the Photometric LSST Astronomical Time Series Classification Challenge (PLAsTiCC)
journal, July 2019

  • Kessler, R.; Narayan, G.; Avelino, A.
  • Publications of the Astronomical Society of the Pacific, Vol. 131, Issue 1003
  • DOI: 10.1088/1538-3873/ab26f1

The Rise Time of Type Ia Supernovae from the Supernova Legacy Survey
journal, September 2006

  • Conley, A.; Howell, D. A.; Howes, A.
  • The Astronomical Journal, Vol. 132, Issue 4
  • DOI: 10.1086/507788

Random Forests for Photometric Redshifts
journal, March 2010

  • Carliles, Samuel; Budavári, Tamás; Heinis, Sébastien
  • The Astrophysical Journal, Vol. 712, Issue 1
  • DOI: 10.1088/0004-637X/712/1/511

FOCAS: The Faint Object Camera and Spectrograph for the Subaru Telescope
journal, December 2002

  • Kashikawa, Nobunari; Aoki, Kentaro; Asai, Ryo
  • Publications of the Astronomical Society of Japan, Vol. 54, Issue 6
  • DOI: 10.1093/pasj/54.6.819

Shock Breakout in type ii Plateau Supernovae: Prospects for High-Redshift Supernova Surveys
journal, March 2011

  • Tominaga, N.; Morokuma, T.; Blinnikov, S. I.
  • The Astrophysical Journal Supplement Series, Vol. 193, Issue 1
  • DOI: 10.1088/0067-0049/193/1/20

Shock Breakout in Core‐Collapse Supernovae and Its Neutrino Signature
journal, July 2003

  • Thompson, Todd A.; Burrows, Adam; Pinto, Philip A.
  • The Astrophysical Journal, Vol. 592, Issue 1
  • DOI: 10.1086/375701

Relative frequencies of Type Ia and Type II supernovae in the chemical evolution of the Galaxy, LMC and SMC
journal, December 1995

  • Tsujimoto, T.; Nomoto, K.; Yoshii, Y.
  • Monthly Notices of the Royal Astronomical Society, Vol. 277, Issue 3
  • DOI: 10.1093/mnras/277.3.945

SN 2016jhj at redshift 0.34: extending the Type II supernova Hubble diagram using the standard candle method
journal, September 2017

  • de Jaeger, T.; Galbany, L.; Filippenko, A. V.
  • Monthly Notices of the Royal Astronomical Society, Vol. 472, Issue 4
  • DOI: 10.1093/mnras/stx2300

Morpheus : A Deep Learning Framework for the Pixel-level Analysis of Astronomical Image Data
journal, May 2020

  • Hausen, Ryan; Robertson, Brant E.
  • The Astrophysical Journal Supplement Series, Vol. 248, Issue 1
  • DOI: 10.3847/1538-4365/ab8868

THE COSMOS2015 CATALOG: EXPLORING THE 1 < z < 6 UNIVERSE WITH HALF A MILLION GALAXIES
journal, June 2016

  • Laigle, C.; McCracken, H. J.; Ilbert, O.
  • The Astrophysical Journal Supplement Series, Vol. 224, Issue 2
  • DOI: 10.3847/0067-0049/224/2/24

The HSC-SSP Transient Survey: Implications from Early Photometry and Rise Time of Normal Type Ia Supernovae
journal, March 2020

  • Jiang, Ji-an; Yasuda, Naoki; Maeda, Keiichi
  • The Astrophysical Journal, Vol. 892, Issue 1
  • DOI: 10.3847/1538-4357/ab76cb

Machine-learning selection of optical transients in the Subaru/Hyper Suprime-Cam survey
journal, October 2016

  • Morii, Mikio; Ikeda, Shiro; Tominaga, Nozomu
  • Publications of the Astronomical Society of Japan, Vol. 68, Issue 6
  • DOI: 10.1093/pasj/psw096

The Complete Calibration of the Color–Redshift Relation (C3R2) Survey: Survey Overview and Data Release 1
journal, May 2017

  • Masters, Daniel C.; Stern, Daniel K.; Cohen, Judith G.
  • The Astrophysical Journal, Vol. 841, Issue 2
  • DOI: 10.3847/1538-4357/aa6f08

Uncertain time-series similarity: return to the basics
journal, July 2012

  • Dallachiesa, Michele; Nushi, Besmira; Mirylenka, Katsiaryna
  • Proceedings of the VLDB Endowment, Vol. 5, Issue 11
  • DOI: 10.14778/2350229.2350278

Enrichment of the Hot Intracluster Medium: Observations
journal, November 2018


Superluminous supernovae at redshifts of 2.05 and 3.90
journal, October 2012

  • Cooke, Jeff; Sullivan, Mark; Gal-Yam, Avishay
  • Nature, Vol. 491, Issue 7423
  • DOI: 10.1038/nature11521

Photometric Supernova Classification with Machine Learning
journal, August 2016

  • Lochner, Michelle; McEwen, Jason D.; Peiris, Hiranya V.
  • The Astrophysical Journal Supplement Series, Vol. 225, Issue 2
  • DOI: 10.3847/0067-0049/225/2/31

SN 2005ap: A Most Brilliant Explosion
journal, October 2007

  • Quimby, Robert M.; Aldering, Greg; Wheeler, J. Craig
  • The Astrophysical Journal, Vol. 668, Issue 2
  • DOI: 10.1086/522862

PHOTOMETRIC TYPE Ia SUPERNOVA CANDIDATES FROM THE THREE-YEAR SDSS-II SN SURVEY DATA
journal, August 2011


A hybrid type Ia supernova with an early flash triggered by helium-shell detonation
journal, October 2017

  • Jiang, Ji-an; Doi, Mamoru; Maeda, Keiichi
  • Nature, Vol. 550, Issue 7674
  • DOI: 10.1038/nature23908

The Supernova Legacy Survey 3-year sample: Type Ia supernovae photometric distances and cosmological constraints
journal, November 2010


A strong ultraviolet pulse from a newborn type Ia supernova
journal, May 2015

  • Cao, Yi; Kulkarni, S. R.; Howell, D. Andrew
  • Nature, Vol. 521, Issue 7552
  • DOI: 10.1038/nature14440

ANN z : Estimating Photometric Redshifts Using Artificial Neural Networks
journal, April 2004

  • Collister, Adrian A.; Lahav, Ofer
  • Publications of the Astronomical Society of the Pacific, Vol. 116, Issue 818
  • DOI: 10.1086/383254

RAPID: Early Classification of Explosive Transients Using Deep Learning
journal, September 2019

  • Muthukrishna, Daniel; Narayan, Gautham; Mandel, Kaisey S.
  • Publications of the Astronomical Society of the Pacific, Vol. 131, Issue 1005
  • DOI: 10.1088/1538-3873/ab1609

The many flavours of photometric redshifts
journal, June 2018


The rate of core Collapse Supernovae to Redshift 2.5 from the Candels and Clash Supernova Surveys
journal, November 2015

  • Strolger, Louis-Gregory; Dahlen, Tomas; Rodney, Steven A.
  • The Astrophysical Journal, Vol. 813, Issue 2
  • DOI: 10.1088/0004-637X/813/2/93

First Cosmology Results Using SNe Ia from the Dark Energy Survey: Analysis, Systematic Uncertainties, and Validation
journal, April 2019


Rapidly Evolving Transients from the Hyper Suprime-Cam SSP Transient Survey
journal, May 2020

  • Tampo, Yusuke; Tanaka, Masaomi; Maeda, Keiichi
  • The Astrophysical Journal, Vol. 894, Issue 1
  • DOI: 10.3847/1538-4357/ab7ccc

Machine learning in APOGEE: Unsupervised spectral classification with
journal, April 2018

  • Garcia-Dias, Rafael; Prieto, Carlos Allende; Almeida, Jorge Sánchez
  • Astronomy & Astrophysics, Vol. 612
  • DOI: 10.1051/0004-6361/201732134

The History of the Cosmic Supernova Rate Derived from the Evolution of the Host Galaxies
journal, August 2000

  • Kobayashi, Chiaki; Tsujimoto, Takuji; Nomoto, Ken’ichi
  • The Astrophysical Journal, Vol. 539, Issue 1
  • DOI: 10.1086/309195

AAOmega: a scientific and optical overview
conference, September 2004

  • Saunders, Will; Bridges, Terry; Gillingham, Peter
  • SPIE Astronomical Telescopes + Instrumentation, SPIE Proceedings
  • DOI: 10.1117/12.550871

The Cosmic Evolution Survey (COSMOS): Overview
journal, September 2007

  • Scoville, N.; Aussel, H.; Brusa, M.
  • The Astrophysical Journal Supplement Series, Vol. 172, Issue 1
  • DOI: 10.1086/516585

Hyper Suprime-Cam: Camera dewar design
journal, September 2017

  • Komiyama, Yutaka; Obuchi, Yoshiyuki; Nakaya, Hidehiko
  • Publications of the Astronomical Society of Japan, Vol. 70, Issue SP1
  • DOI: 10.1093/pasj/psx069

LSST: From Science Drivers to Reference Design and Anticipated Data Products
journal, March 2019

  • Ivezić, Željko; Kahn, Steven M.; Tyson, J. Anthony
  • The Astrophysical Journal, Vol. 873, Issue 2
  • DOI: 10.3847/1538-4357/ab042c

Photometric redshifts for Hyper Suprime-Cam Subaru Strategic Program Data Release 1
journal, October 2017

  • Tanaka, Masayuki; Coupon, Jean; Hsieh, Bau-Ching
  • Publications of the Astronomical Society of Japan, Vol. 70, Issue SP1
  • DOI: 10.1093/pasj/psx077

Unity: Confronting Supernova Cosmology’S Statistical and Systematic Uncertainties in a Unified Bayesian Framework
journal, November 2015


On the evolution of the cosmic supernova rates
journal, June 1998


Measuring Dark Energy Properties with Photometrically Classified Pan-STARRS Supernovae. II. Cosmological Parameters
journal, April 2018


Luminous Supernovae
journal, August 2012


The volumetric rate of normal type Ia supernovae in the local Universe discovered by the Palomar Transient Factory
journal, March 2019

  • Frohmaier, C.; Sullivan, M.; Nugent, P. E.
  • Monthly Notices of the Royal Astronomical Society, Vol. 486, Issue 2
  • DOI: 10.1093/mnras/stz807

SALT2: using distant supernovae to improve the use of type Ia supernovae as distance indicators
journal, February 2007


Finding strong gravitational lenses in the Kilo Degree Survey with Convolutional Neural Networks
journal, August 2017

  • Petrillo, C. E.; Tortora, C.; Chatterjee, S.
  • Monthly Notices of the Royal Astronomical Society, Vol. 472, Issue 1
  • DOI: 10.1093/mnras/stx2052

A Modified Magnitude System that Produces Well-Behaved Magnitudes, Colors, and Errors Even for Low Signal-to-Noise Ratio Measurements
journal, September 1999

  • Lupton, Robert H.; Gunn, James E.; Szalay, Alexander S.
  • The Astronomical Journal, Vol. 118, Issue 3
  • DOI: 10.1086/301004

SYSTEMATIC UNCERTAINTIES ASSOCIATED WITH THE COSMOLOGICAL ANALYSIS OF THE FIRST PAN-STARRS1 TYPE Ia SUPERNOVA SAMPLE
journal, October 2014


A Measurement of the Rate of Type Ia Supernovae at Redshift z ≈ 0.1 from the First Season of the SDSS‐II Supernova Survey
journal, July 2008

  • Dilday, Benjamin; Kessler, Richard; Frieman, Joshua A.
  • The Astrophysical Journal, Vol. 682, Issue 1
  • DOI: 10.1086/587733

Chemodynamical Simulations of the Milky way Galaxy
journal, February 2011


Hydrogen-poor superluminous stellar explosions
journal, June 2011

  • Quimby, R. M.; Kulkarni, S. R.; Kasliwal, M. M.
  • Nature, Vol. 474, Issue 7352
  • DOI: 10.1038/nature10095

Simulations of the WFIRST Supernova Survey and Forecasts of Cosmological Constraints
journal, October 2018


Cosmological Parameter Uncertainties from Salt-Ii type ia Supernova Light Curve Models
journal, August 2014


Exploring the Expansion History of the Universe
journal, March 2003


Measurements of Ω and Λ from 42 High‐Redshift Supernovae
journal, June 1999

  • Perlmutter, S.; Aldering, G.; Goldhaber, G.
  • The Astrophysical Journal, Vol. 517, Issue 2
  • DOI: 10.1086/307221

The Hyper Suprime-Cam SSP transient survey in COSMOS: Overview
journal, May 2019

  • Yasuda, Naoki; Tanaka, Masaomi; Tominaga, Nozomu
  • Publications of the Astronomical Society of Japan, Vol. 71, Issue 4
  • DOI: 10.1093/pasj/psz050

Standard Solar Composition
journal, January 1998


Machine-learning-based Brokers for Real-time Classification of the LSST Alert Stream
journal, May 2018

  • Narayan, Gautham; Zaidi, Tayeb; Soraisam, Monika D.
  • The Astrophysical Journal Supplement Series, Vol. 236, Issue 1
  • DOI: 10.3847/1538-4365/aab781

Deep Recurrent Neural Networks for Supernovae Classification
journal, March 2017


The Peculiar SN 2005hk: Do Some Type Ia Supernovae Explode as Deflagrations?
journal, April 2007

  • Phillips, M. M.; Li, Weidong; Frieman, Joshua A.
  • Publications of the Astronomical Society of the Pacific, Vol. 119, Issue 854
  • DOI: 10.1086/518372

Improved cosmological constraints from a joint analysis of the SDSS-II and SNLS supernova samples
journal, August 2014


The type Ia supernova SNLS-03D3bb from a super-Chandrasekhar-mass white dwarf star
journal, September 2006

  • Andrew Howell, D.; Sullivan, Mark; Nugent, Peter E.
  • Nature, Vol. 443, Issue 7109
  • DOI: 10.1038/nature05103

DASH: Deep Learning for the Automated Spectral Classification of Supernovae and Their Hosts
journal, November 2019

  • Muthukrishna, Daniel; Parkinson, David; Tucker, Brad E.
  • The Astrophysical Journal, Vol. 885, Issue 1
  • DOI: 10.3847/1538-4357/ab48f4

The on-site quality-assurance system for Hyper Suprime-Cam: OSQAH†
journal, September 2017

  • Furusawa, Hisanori; Koike, Michitaro; Takata, Tadafumi
  • Publications of the Astronomical Society of Japan, Vol. 70, Issue SP1
  • DOI: 10.1093/pasj/psx079