DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Electronic structure prediction of multi-million atom systems through uncertainty quantification enabled transfer learning

Journal Article · · npj Computational Materials

Abstract The ground state electron density — obtainable using Kohn-Sham Density Functional Theory (KS-DFT) simulations — contains a wealth of material information, making its prediction via machine learning (ML) models attractive. However, the computational expense of KS-DFT scales cubically with system size which tends to stymie training data generation, making it difficult to develop quantifiably accurate ML models that are applicable across many scales and system configurations. Here, we address this fundamental challenge by employing transfer learning to leverage the multi-scale nature of the training data, while comprehensively sampling system configurations using thermalization. Our ML models are less reliant on heuristics, and being based on Bayesian neural networks, enable uncertainty quantification. We show that our models incur significantly lower data generation costs while allowing confident — and when verifiable, accurate — predictions for a wide variety of bulk systems well beyond training, including systems with defects, different alloy compositions, and at multi-million-atom scales. Moreover, such predictions can be carried out using only modest computational resources.

Sponsoring Organization:
USDOE
Grant/Contract Number:
SC0023432
OSTI ID:
2429095
Journal Information:
npj Computational Materials, Journal Name: npj Computational Materials Journal Issue: 1 Vol. 10; ISSN 2057-3960
Publisher:
Nature Publishing GroupCopyright Statement
Country of Publication:
United Kingdom
Language:
English

References (96)

Linear-Scaling ab-initio Calculations for Large and Complex Systems journal September 1999
The high temperature bulk modulus of aluminium: an assessment using experimental enthalpy and thermal expansion data journal June 2002
Machine learning electron density in sulfur crosslinked carbon nanotubes journal September 2018
Atomsk: A tool for manipulating and converting atomic data files journal December 2015
Spectral Quadrature method for accurate O ( N ) electronic structure calculations of metals and insulators journal March 2016
SPARC: Accurate and efficient finite-difference formulation and parallel implementation of Density Functional Theory: Isolated clusters journal March 2017
SQDFT: Spectral Quadrature method for large-scale parallel O ( N ) Kohn–Sham calculations at high temperature journal March 2018
DeePMD-kit: A deep learning package for many-body potential energy representation and molecular dynamics journal July 2018
DFT-FE 1.0: A massively parallel hybrid CPU-GPU density functional theory code using finite-element discretization journal November 2022
Periodic Pulay method for robust and efficient convergence acceleration of self-consistent field iterations journal March 2016
Refractory high-entropy alloys journal September 2010
Mechanical properties of Nb25Mo25Ta25W25 and V20Nb20Mo20Ta20W20 refractory high entropy alloys journal May 2011
Deep Density: Circumventing the Kohn-Sham equations via symmetry preserving neural networks journal October 2021
Density functional theory method for twisted geometries with application to torsional deformations in group-IV nanotubes journal May 2022
Solution of the Schrödinger equation for quasi-one-dimensional materials using helical waves journal January 2024
Ab initio framework for systems with helical symmetry: Theory, numerical implementation and applications to torsional deformations in nanostructures journal September 2021
Ab initio phase stabilities and mechanical properties of multicomponent alloys: A comprehensive review for high entropy alloys and compositionally complex alloys journal January 2019
Machine-learned prediction of the electronic fields in a crystal journal December 2021
Electronic structure of complex Hume-Rothery phases and quasicrystals in transition metal aluminides journal August 2005
High performance computing of DGDFT for tens of thousands of atoms using millions of cores on Sunway TaihuLight journal January 2021
M-SPARC: Matlab-Simulation Package for Ab-initio Real-space Calculations journal January 2020
SPARC: Simulation Package for Ab-initio Real-space Calculations journal July 2021
Interacting Electrons: Theory and Computational Approaches book June 2016
Physics-Inspired Structural Representations for Molecules and Materials journal July 2021
Gaussian Process Regression for Materials and Molecules journal August 2021
Learning Electron Densities in the Condensed Phase journal October 2021
Two-Level Chebyshev Filter Based Complementary Subspace Method: Pushing the Envelope of Large-Scale Electronic Structure Calculations journal April 2018
Transferable Machine-Learning Model of the Electron Density journal December 2018
A Chirality-Based Quantum Leap journal March 2022
Van der Waals heterostructures journal July 2013
Bypassing the Kohn-Sham equations with machine learning journal October 2017
Approaching coupled cluster accuracy with a general-purpose neural network potential through transfer learning journal July 2019
Exact exchange-correlation potentials from ground-state electron densities journal October 2019
Predicting defect behavior in B2 intermetallics by merging ab initio modeling and machine learning journal December 2016
Solving the electronic structure problem with machine learning journal February 2019
Equivariant graph neural networks for fast electron density estimation of molecules, liquids, and solids journal August 2022
Predicting electronic structures at any length scale with machine learning journal June 2023
Higher-order equivariant neural networks for charge density prediction in materials journal July 2024
High-entropy alloys journal June 2019
Electronic-structure methods for twisted moiré layers journal July 2020
Device-scale atomistic modelling of phase-change memory materials journal September 2023
CHGNet as a pretrained universal neural network potential for charge-informed atomistic modelling journal September 2023
A universal graph deep learning interatomic potential for the periodic table journal November 2022
Recent advances and outstanding challenges for machine learning interatomic potentials journal December 2023
Comparing molecules and solids across structural and alchemical space journal January 2016
Electron density learning of non-covalent systems journal January 2019
A review on the use of DFT for the prediction of the properties of nanomaterials journal January 2021
Machine learning transferable atomic forces for large systems from underconverged molecular fragments journal January 2023
Introducing ONETEP : Linear-scaling density functional simulations on parallel computers journal February 2005
The Nose–Hoover thermostat journal October 1985
A density‐matrix divide‐and‐conquer approach for electronic structure calculations of large molecules journal October 1995
wACSF—Weighted atom-centered symmetry functions as descriptors in machine learning potentials journal June 2018
Automatic selection of atomic fingerprints and reference configurations for machine-learning potentials journal June 2018
Equivariant representations for molecular Hamiltonians and N-center atomic-scale properties journal January 2022
A Hessian-based assessment of atomic forces for training machine learning interatomic potentials journal March 2022
Charge-density based evaluation and prediction of stacking fault energies in Ni alloys from DFT and machine learning journal December 2022
Real-space solution to the electronic structure problem for nearly a million electrons journal June 2023
Nearsightedness of electronic matter journal August 2005
Electronic properties of semiconductor alloy systems journal August 1985
Designing meaningful density functional theory calculations in materials science—a primer journal November 2004
Roadmap on electronic structure codes in the exascale era journal August 2023
Roadmap on Machine Learning in Electronic Structure journal February 2022
Density functional theory across chemistry, physics and biology
  • van Mourik, Tanja; Bühl, Michael; Gaigeot, Marie-Pierre
  • Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences, Vol. 372, Issue 2011 https://doi.org/10.1098/rsta.2012.0488
journal March 2014
Inhomogeneous Electron Gas journal November 1964
Self-Consistent Equations Including Exchange and Correlation Effects journal November 1965
Accelerating finite-temperature Kohn-Sham density functional theory with deep neural networks journal July 2021
Machine learning based prediction of the electronic structure of quasi-one-dimensional materials under strain journal May 2022
Simplified method for calculating the energy of weakly interacting fragments journal February 1985
Tight-binding models and density-functional theory journal June 1989
Electronic properties of random alloys: Special quasirandom structures journal November 1990
Critical magnetic properties of disordered polycrystalline Cr 75 Fe 25 and Cr 70 Fe 30 alloys journal January 2002
Vacancy clustering and prismatic dislocation loop formation in aluminum journal November 2007
On representing chemical environments journal May 2013
Optimized norm-conserving Vanderbilt pseudopotentials journal August 2013
Sparse representation for a potential energy surface journal July 2014
Subquadratic-scaling subspace projection method for large-scale Kohn-Sham density functional theory calculations using spectral finite-element discretization journal September 2014
Fast and Accurate Modeling of Molecular Atomization Energies with Machine Learning journal January 2012
Finding Density Functionals with Machine Learning journal June 2012
Symmetry-Adapted Machine Learning for Tensorial Properties of Atomistic Systems journal January 2018
Density Functional and Density Matrix Method Scaling Linearly with the Number of Atoms journal April 1996
Generalized Gradient Approximation Made Simple journal October 1996
Electron Localization in the Insulating State journal January 1999
Flexible Ab Initio Boundary Conditions: Simulating Isolated Dislocations in bcc Mo and Ta journal May 2002
“Learn on the Fly”: A Hybrid Classical and Quantum-Mechanical Molecular Dynamics Simulation journal October 2004
Generalized Neural-Network Representation of High-Dimensional Potential-Energy Surfaces journal April 2007
Linear scaling electronic structure methods journal July 1999
A Comprehensive Survey on Transfer Learning journal January 2021
Linearly scaling 3D fragment method for large-scale electronic structure calculations conference November 2008
2.5 Million-Atom Ab Initio Electronic-Structure Simulation of Complex Metallic Heterostructures with DGDFT conference November 2022
Explanation and Use of Uncertainty Quantified by Bayesian Neural Network Classifiers for Breast Histopathology Images journal April 2022
Machine learning unifies the modeling of materials and molecules journal December 2017
Keeping the neural networks simple by minimizing the description length of the weights conference January 1993
SelInv---An Algorithm for Selected Inversion of a Sparse Symmetric Matrix journal February 2011
Toward Computational Materials Design: The Impact of Density Functional Theory on Materials Research journal September 2006
Machine-learning potentials for crystal defects journal August 2022
Fast algorithm for extracting the diagonal of the inverse matrix with application to the electronic structure analysis of metallic systems journal January 2009

Similar Records

Machine-learning Kohn–Sham potential from dynamics in time-dependent Kohn–Sham systems
Journal Article · 2023 · Machine Learning: Science and Technology · OSTI ID:1996030

DeePKS + ABACUS as a Bridge between Expensive Quantum Mechanical Models and Machine Learning Potentials
Journal Article · 2022 · Journal of Physical Chemistry. A, Molecules, Spectroscopy, Kinetics, Environment, and General Theory · OSTI ID:1994169

Kohn–Sham accuracy from orbital-free density functional theory via Δ-machine learning
Journal Article · 2023 · Journal of Chemical Physics · OSTI ID:2283289

Related Subjects