Practical galaxy morphology tools from deep supervised representation learning
Journal Article
·
· Monthly Notices of the Royal Astronomical Society
- University of Manchester (United Kingdom)
- University of Manchester (United Kingdom); Alan Turing Institute, London (United Kingdom)
- University of Oxford (United Kingdom)
- University of the Western Cape, Cape Town (South Africa); South African Radio Astronomy Observatory (SARAO), Cape Town (South Africa)
- University of the Western Cape, Cape Town (South Africa)
- The Open University, Kents Hill (United Kingdom)
- University of Minnesota, Minneapolis, MN (United States)
- Max-Planck-Institut fur extraterrestrische Physik, Garching bei München, (Germany); European Space Agency, Noordwijk (Netherlands)
- Haverford College, PA (United States)
- Lancaster University, Bailrigg (United Kingdom)
Astronomers have typically set out to solve supervised machine learning problems by creating their own representations from scratch. We show that deep learning models trained to answer every Galaxy Zoo DECaLS question learn meaningful semantic representations of galaxies that are useful for new tasks on which the models were never trained. We exploit these representations to outperform several recent approaches at practical tasks crucial for investigating large galaxy samples. The first task is identifying galaxies of similar morphology to a query galaxy. Given a single galaxy assigned a free text tag by humans (e.g. ‘#diffuse’), we can find galaxies matching that tag for most tags. The second task is identifying the most interesting anomalies to a particular researcher. Our approach is 100 per cent accurate at identifying the most interesting 100 anomalies (as judged by Galaxy Zoo 2 volunteers). The third task is adapting a model to solve a new task using only a small number of newly labelled galaxies. Models fine-tuned from our representation are better able to identify ring galaxies than models fine-tuned from terrestrial images (ImageNet) or trained from scratch. We solve each task with very few new labels; either one (for the similarity search) or several hundred (for anomaly detection or fine-tuning). This challenges the longstanding view that deep supervised methods require new large labelled data sets for practical use in astronomy. To help the community benefit from our pretrained models, we release our fine-tuning code zoobot. Zoobot is accessible to researchers with no prior experience in deep learning.
- Research Organization:
- Lawrence Berkeley National Laboratory (LBNL), Berkeley, CA (United States). National Energy Research Scientific Computing Center (NERSC); University of Minnesota, Minneapolis, MN (United States)
- Sponsoring Organization:
- Alan Turing Institute; Alfred P. Sloan Foundation; National Research Foundation (NRF); National Science Foundation (NSF); South African Radio Astronomy Observatory; USDOE Office of Science (SC), High Energy Physics (HEP)
- Grant/Contract Number:
- AC02-05CH11231
- OSTI ID:
- 1982680
- Journal Information:
- Monthly Notices of the Royal Astronomical Society, Journal Name: Monthly Notices of the Royal Astronomical Society Journal Issue: 2 Vol. 513; ISSN 0035-8711
- Publisher:
- Oxford University PressCopyright Statement
- Country of Publication:
- United States
- Language:
- English
Similar Records
Self-supervised Representation Learning for Astronomical Images
RINO: Renormalization Group Invariance with No Labels
Masked Particle Modeling on Sets: Towards Self-Supervised High Energy Physics Foundation Models
Journal Article
·
Sun Apr 25 20:00:00 EDT 2021
· The Astrophysical Journal. Letters
·
OSTI ID:1813371
RINO: Renormalization Group Invariance with No Labels
Conference
·
Tue Sep 09 00:00:00 EDT 2025
· No journal information
·
OSTI ID:3003666
Masked Particle Modeling on Sets: Towards Self-Supervised High Energy Physics Foundation Models
Journal Article
·
Tue Jul 16 20:00:00 EDT 2024
· Machine Learning: Science and Technology
·
OSTI ID:2403614