Explainable Neural Architecture Search (XNAS)

RESOURCE

Abstract

Code for the paper Learning Interpretable Models Through Multi-Objective Neural Architecture Search by Zachariah Carmichael, Tim Moon, and Sam Ade Jacobs. Monumental advances in deep learning have led to unprecedented achievements across a multitude of domains. While the performance of deep neural networks is indubitable, the architectural design and interpretability of such models are nontrivial. Research has been introduced to automate the design of neural network architectures through neural architecture search (NAS). Recent progress has made these methods more pragmatic by exploiting distributed computation and novel optimization algorithms. However, there is little work in optimizing architectures for interpretability. To this end, we propose a multiobjective distributed NAS framework that optimizes for both task performance and introspection. We leverage the non-dominated sorting genetic algorithm (NSGA-II) and explainable AI (XAI) techniques to reward architectures that can be better comprehended by humans. The framework is evaluated on several image classification datasets. We demonstrate that jointly optimizing for introspection ability and task error leads to more disentangled architectures that perform within tolerable error.
Developers:
Carmichael, Zachariah [1] Moon, Timothy [1] Jacobs, Samson [1]
  1. Lawrence Livermore National Lab. (LLNL), Livermore, CA (United States)
Release Date:
2021-12-10
Project Type:
Open Source, Publicly Available Repository
Software Type:
Scientific
Version:
0.0
Licenses:
MIT License
Sponsoring Org.:
Code ID:
70518
Site Accession Number:
LLNL-CODE-831992
Research Org.:
Lawrence Livermore National Laboratory (LLNL), Livermore, CA (United States)
Country of Origin:
United States

RESOURCE

Citation Formats

Carmichael, Zachariah J., Moon, Timothy Y., and Jacobs, Samson A. Explainable Neural Architecture Search (XNAS). Computer Software. https://github.com/LLNL/XNAS. USDOE National Nuclear Security Administration (NNSA). 10 Dec. 2021. Web. doi:10.11578/dc.20220303.4.
Carmichael, Zachariah J., Moon, Timothy Y., & Jacobs, Samson A. (2021, December 10). Explainable Neural Architecture Search (XNAS). [Computer software]. https://github.com/LLNL/XNAS. https://doi.org/10.11578/dc.20220303.4.
Carmichael, Zachariah J., Moon, Timothy Y., and Jacobs, Samson A. "Explainable Neural Architecture Search (XNAS)." Computer software. December 10, 2021. https://github.com/LLNL/XNAS. https://doi.org/10.11578/dc.20220303.4.
@misc{ doecode_70518,
title = {Explainable Neural Architecture Search (XNAS)},
author = {Carmichael, Zachariah J. and Moon, Timothy Y. and Jacobs, Samson A.},
abstractNote = {Code for the paper Learning Interpretable Models Through Multi-Objective Neural Architecture Search by Zachariah Carmichael, Tim Moon, and Sam Ade Jacobs. Monumental advances in deep learning have led to unprecedented achievements across a multitude of domains. While the performance of deep neural networks is indubitable, the architectural design and interpretability of such models are nontrivial. Research has been introduced to automate the design of neural network architectures through neural architecture search (NAS). Recent progress has made these methods more pragmatic by exploiting distributed computation and novel optimization algorithms. However, there is little work in optimizing architectures for interpretability. To this end, we propose a multiobjective distributed NAS framework that optimizes for both task performance and introspection. We leverage the non-dominated sorting genetic algorithm (NSGA-II) and explainable AI (XAI) techniques to reward architectures that can be better comprehended by humans. The framework is evaluated on several image classification datasets. We demonstrate that jointly optimizing for introspection ability and task error leads to more disentangled architectures that perform within tolerable error.},
doi = {10.11578/dc.20220303.4},
url = {https://doi.org/10.11578/dc.20220303.4},
howpublished = {[Computer Software] \url{https://doi.org/10.11578/dc.20220303.4}},
year = {2021},
month = {dec}
}