Title: Multi-task graph neural networks for simultaneous prediction of global and atomic properties in ferromagnetic systems *

Journal Article · · Machine Learning: Science and Technology

Abstract We introduce a multi-tasking graph convolutional neural network, HydraGNN, to simultaneously predict both global and atomic physical properties and demonstrate with ferromagnetic materials. We train HydraGNN on an open-source ab initio density functional theory (DFT) dataset for iron-platinum with a fixed body centered tetragonal lattice structure and fixed volume to simultaneously predict the mixing enthalpy (a global feature of the system), the atomic charge transfer, and the atomic magnetic moment across configurations that span the entire compositional range. By taking advantage of underlying physical correlations between material properties, multi-task learning (MTL) with HydraGNN provides effective training even with modest amounts of data. Moreover, this is achieved with just one architecture instead of three, as required by single-task learning (STL). The first convolutional layers of the HydraGNN architecture are shared by all learning tasks and extract features common to all material properties. The following layers discriminate the features of the different properties, the results of which are fed to the separate heads of the final layer to produce predictions. Numerical results show that HydraGNN effectively captures the relation between the configurational entropy and the material properties over the entire compositional range. Overall, the accuracy of simultaneous MTL predictions is comparable to the accuracy of the STL predictions. In addition, the computational cost of training HydraGNN for MTL is much lower than the original DFT calculations and also lower than training separate STL models for each property.

Research Organization:
Oak Ridge National Laboratory (ORNL), Oak Ridge, TN (United States)
Sponsoring Organization:
USDOE; USDOE Laboratory Directed Research and Development (LDRD) Program; USDOE Office of Science (SC)
Grant/Contract Number:
AC05-00OR22725
OSTI ID:
1866628
Journal Information:
Machine Learning: Science and Technology, Journal Name: Machine Learning: Science and Technology Journal Issue: 2 Vol. 3; ISSN 2632-2153
Publisher:
IOP PublishingCopyright Statement
Country of Publication:
United Kingdom
Language:
English

References (31)

Materials Design and Discovery with High-Throughput Density Functional Theory: The Open Quantum Materials Database (OQMD) journal September 2013
Multitask Learning: A Knowledge-Based Source of Inductive Bias book June 1993
AFLOW: An automatic framework for high-throughput materials discovery journal June 2012
GPU acceleration of the Locally Selfconsistent Multiple Scattering code for first principles calculation of the ground state and statistical physics of materials journal February 2017
Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations journal February 2019
A scalable algorithm for the optimization of neural network architectures journal July 2021
Graph Networks as a Universal Machine Learning Framework for Molecules and Crystals journal April 2019
Is Multitask Deep Learning Practical for Pharma? journal August 2017
Accelerated search for materials with targeted properties by adaptive design journal April 2016
Design of efficient molecular organic light-emitting diodes by a high-throughput virtual screening and experimental approach journal August 2016
Accelerated discovery of stable lead-free hybrid organic-inorganic perovskites via machine learning journal August 2018
Physically informed artificial neural networks for atomistic modeling of materials journal May 2019
Atomistic Line Graph Neural Network for improved materials property predictions journal November 2021
Recent advances and applications of deep learning methods in materials science journal April 2022
Author Correction: Magnetism and high magnetic-field-induced stability of alloy carbides in Fe-based materials journal May 2018
Combinatorial evaluation of phase formation and magnetic properties of FeMnCoCrAl high entropy alloy thin film library journal May 2019
Physics-informed machine learning journal May 2021
Commentary: The Materials Project: A materials genome approach to accelerating materials innovation journal July 2013
Perspective: Web-based machine learning models for real-time screening of thermoelectric materials properties journal May 2016
Magnetic alloys, their electronic structure and micromagnetic and microstructural models journal October 1998
Fast and stable deep-learning predictions of material properties for solid solution alloys** journal December 2020
Inhomogeneous Electron Gas journal November 1964
Self-Consistent Equations Including Exchange and Correlation Effects journal November 1965
Crystal Graph Convolutional Neural Networks for an Accurate and Interpretable Prediction of Material Properties journal April 2018
Unified Approach for Molecular Dynamics and Density-Functional Theory journal November 1985
Order- N Multiple Scattering Approach to Electronic Structure Calculations journal October 1995
Developing an improved crystal graph convolutional neural network framework for accelerated materials discovery journal June 2020
The Graph Neural Network Model journal December 2008
FePt binary alloy with 32 atoms - LSMS-3 data
  • Pasini, Massimiliano; Eisenbach, Markus
  • Oak Ridge National Laboratory (ORNL), Oak Ridge, TN (United States). Oak Ridge Leadership Computing Facility (OLCF); Oak Ridge National Laboratory (ORNL), Oak Ridge, TN (United States) https://doi.org/10.13139/OLCF/1762742
dataset January 2021
Fast Graph Representation Learning with PyTorch Geometric preprint January 2019
PyTorch: An Imperative Style, High-Performance Deep Learning Library preprint January 2019