Home > Research > Publications & Outputs > Practical galaxy morphology tools from deep sup...

Electronic data

  • Author Accepted Version

    Accepted author manuscript, 4.8 MB, PDF document

    Available under license: CC BY: Creative Commons Attribution 4.0 International License

Text available via DOI:

View graph of relations

Practical galaxy morphology tools from deep supervised representation learning

Research output: Contribution to Journal/MagazineJournal articlepeer-review

E-pub ahead of print
  • Mike Walmsley
  • Anna M M Scaife
  • Chris Lintott
  • Michelle Lochner
  • Verlon Etsebeth
  • Tobias Géron
  • Hugh Dickinson
  • Lucy Fortson
  • Sandor Kruk
  • Karen L Masters
  • Kameswara Bharadwaj Mantha
  • Brooke D Simmons
<mark>Journal publication date</mark>28/02/2022
<mark>Journal</mark>Monthly Notices of the Royal Astronomical Society
Publication StatusE-pub ahead of print
Early online date28/02/22
<mark>Original language</mark>English


Astronomers have typically set out to solve supervised machine learning problems by creating their own representations from scratch. We show that deep learning models trained to answer every Galaxy Zoo DECaLS question learn meaningful semantic representations of galaxies that are useful for new tasks on which the models were never trained. We exploit these representations to outperform several recent approaches at practical tasks crucial for investigating large galaxy samples. The first task is identifying galaxies of similar morphology to a query galaxy. Given a single galaxy assigned a free text tag by humans (e.g. ‘#diffuse’), we can find galaxies matching that tag for most tags. The second task is identifying the most interesting anomalies to a particular researcher. Our approach is 100 per cent accurate at identifying the most interesting 100 anomalies (as judged by Galaxy Zoo 2 volunteers). The third task is adapting a model to solve a new task using only a small number of newly-labelled galaxies. Models fine-tuned from our representation are better able to identify ring galaxies than models fine-tuned from terrestrial images (ImageNet) or trained from scratch. We solve each task with very few new labels; either one (for the similarity search) or several hundred (for anomaly detection or fine-tuning). This challenges the longstanding view that deep supervised methods require new large labelled datasets for practical use in astronomy. To help the community benefit from our pretrained models, we release our fine-tuning code zoobot. Zoobot is accessible to researchers with no prior experience in deep learning.