DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: XElemNet: towards explainable AI for deep neural networks in materials science

Journal Article · · Scientific Reports

Abstract Recent progress in deep learning has significantly impacted materials science, leading to accelerated material discovery and innovation. ElemNet, a deep neural network model that predicts formation energy from elemental compositions, exemplifies the application of deep learning techniques in this field. However, the “black-box” nature of deep learning models often raises concerns about their interpretability and reliability. In this study, we propose XElemNet to explore the interpretability of ElemNet by applying a series of explainable artificial intelligence (XAI) techniques, focusing on post-hoc analysis and model transparency. The experiments with artificial binary datasets reveal ElemNet’s effectiveness in predicting convex hulls of element-pair systems across periodic table groups, indicating its capability to effectively discern elemental interactions in most cases. Additionally, feature importance analysis within ElemNet highlights alignment with chemical properties of elements such as reactivity and electronegativity. XElemNet provides insights into the strengths and limitations of ElemNet and offers a potential pathway for explaining other deep learning models in materials science.

Sponsoring Organization:
USDOE
Grant/Contract Number:
SC0021399
OSTI ID:
2473509
Journal Information:
Scientific Reports, Journal Name: Scientific Reports Journal Issue: 1 Vol. 14; ISSN 2045-2322
Publisher:
Nature Publishing GroupCopyright Statement
Country of Publication:
United Kingdom
Language:
English

References (43)

The thermal properties of holmium trifluoride at high temperatures journal January 2000
An overview of halogen bonding journal September 2006
The thermodynamic properties of DyF3, HoF3, ErF3, and TmF3: galvanic-cell measurements using solid CaF2 electrolyte journal November 1979
New anisotropic rare earth fluorides BaR2F8 (R=Y, Dy–Lu): growth and characterization journal July 1998
Explaining black-box classifiers using post-hoc explanations-by-example: The effect of explanations and error-rates in XAI user studies journal May 2021
Deep learning approaches for mining structure-property linkages in high contrast composites from simulation datasets journal August 2018
Methods for interpreting and understanding deep neural networks journal February 2018
Usformer: A small network for left atrium segmentation of 3D LGE MRI journal April 2024
Excited state properties of lanthanide complexes: Beyond ff states journal September 2006
Deep learning in bioinformatics: Introduction, application, and perspective in the big data era journal August 2019
MPpredictor: An Artificial Intelligence-Driven Web Tool for Composition-Based Material Property Prediction journal March 2023
Characterization of Oxides of Cesium journal August 2004
Deep Learning for Geophysics: Current and Future Trends journal July 2021
The Open Quantum Materials Database (OQMD): assessing the accuracy of DFT formation energies journal December 2015
Cross-property deep transfer learning framework for enhanced predictive analytics on small materials data journal November 2021
The joint automated repository for various integrated simulations (JARVIS) for data-driven materials design journal November 2020
Explainable machine learning in materials science journal September 2022
A guide to deep learning in healthcare journal January 2019
ElemNet: Deep Learning the Chemistry of Materials From Only Elemental Composition journal December 2018
Iodine-free redox couples for dye-sensitized solar cells journal January 2011
Thermodynamics of the lanthanide trifluorides. I. The heat capacity of lanthanum trifluoride, LaF3 from 5 to 350°K and enthalpies from 298 to 1477°K journal July 1978
Methodology for vetting heavily doped semiconductors for intermediate band photovoltaics: A case study in sulfur-hyperdoped silicon journal September 2013
Perspective: Materials informatics and big data: Realization of the “fourth paradigm” of science in materials science journal April 2016
A deep learning approach to cosmological dark energy models journal March 2020
Deep learning for healthcare: review, opportunities and challenges journal May 2017
The revival of the Gini importance? journal May 2018
Combinatorial screening for new materials in unconstrained composition space with machine learning journal March 2014
Crystal Graph Convolutional Neural Networks for an Accurate and Interpretable Prediction of Material Properties journal April 2018
Nobel Lecture: Electronic structure of matter—wave functions and density functionals journal October 1999
Exascale Deep Learning for Climate Analytics conference November 2018
CosmoFlow: Using Deep Learning to Learn the Universe at Scale
  • Mathuriya, Amrita; Bard, Deborah; Mendygral, Peter
  • SC18: International Conference for High Performance Computing, Networking, Storage and Analysis https://doi.org/10.1109/SC.2018.00068
conference November 2018
How Strong Is a Covalent Bond? journal March 1999
"Why Should I Trust You?": Explaining the Predictions of Any Classifier
  • Ribeiro, Marco Tulio; Singh, Sameer; Guestrin, Carlos
  • Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining - KDD '16 https://doi.org/10.1145/2939672.2939778
conference January 2016
Palm conference May 2017
A Survey of Methods for Explaining Black Box Models journal January 2019
The Mythos of Model Interpretability: In machine learning, the concept of interpretability is both important and slippery. journal June 2018
A comparison of random forest and its Gini importance with standard chemometric methods for the feature selection and classification of spectral data journal January 2009
The chemistry of chromium and some resulting analytical problems. journal May 1991
Deep materials informatics: Applications of deep learning in materials science journal June 2019
Toward Computational Materials Design: The Impact of Density Functional Theory on Materials Research journal September 2006
Evolution of artificial intelligence for application in contemporary materials science journal August 2023
Potassium Azide as a Nitrification Inhibitor1 journal September 1970
Principles and Practice of Explainable Machine Learning journal July 2021