Deep Multimodal Networks for M-type Star Classification with Paired Spectrum and Photometric Image
Abstract
Traditional stellar classification methods include spectral and photometric classification separately. Although satisfactory results can be achieved, the accuracy could be improved. In this paper, we pioneer a novel approach to deeply fuse the spectra and photometric images of the sources in an advanced multimodal network to enhance the model’s discriminatory ability. We use Transformer as the fusion module and apply a spectrum–image contrastive loss function to enhance the consistency of the spectrum and photometric image of the same source in two different feature spaces. We perform M-type stellar subtype classification on two data sets with high and low signal-to-noise ratio (S/N) spectra and corresponding photometric images, and the F1-score achieves 95.65% and 90.84%, respectively. In our experiments, we prove that our model effectively utilizes the information from photometric images and is more accurate than advanced spectrum and photometric image classifiers. Our contributions can be summarized as follows: (1) We propose an innovative idea for stellar classification that allows the model to simultaneously consider information from spectra and photometric images. (2) We discover the challenge of fusing low-S/N spectra and photometric images in the Transformer and provide a solution. (3) The effectiveness of Transformer for spectral classification is discussed for the first time and will inspire more Transformer-based spectral classification models.
- Research Organization:
- US Department of Energy (USDOE), Washington, DC (United States). Office of Science, Sloan Digital Sky Survey (SDSS)
- Sponsoring Organization:
- USDOE
- OSTI ID:
- 2425147
- Journal Information:
- Publications of the Astronomical Society of the Pacific, Journal Name: Publications of the Astronomical Society of the Pacific Journal Issue: 1046 Vol. 135; ISSN 0004-6280
- Publisher:
- Astronomical Society of the Pacific (ASP)
- Country of Publication:
- United States
- Language:
- English
Similar Records
Application of convolutional neural networks for stellar spectral classification
THE PHOTOMETRIC CLASSIFICATION SERVER FOR Pan-STARRS1