DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Design and analysis of machine learning exchange-correlation functionals via rotationally invariant convolutional descriptors

Journal Article · · Physical Review Materials
 [1];  [2]
  1. Georgia Inst. of Technology, Atlanta, GA (United States); Georgia Institute of Technology
  2. Georgia Inst. of Technology, Atlanta, GA (United States)

Here, we explore the potential of a data-driven approach to the design of exchange-correlation (xc) functionals. The approach, inspired by convolutional filters in computer vision and surrogate functions from optimization, utilizes convolutions of the electron density to form a feature space to represent local electronic environments and neural networks to map the features to the exchange-correlation energy density. These features are orbital free, and provide a systematic route to including information at various length scales. This work shows that convolutional descriptors are theoretically capable of an exact representation of the electron density, and proposes Maxwell-Cartesian spherical harmonic kernels as a class of rotationally invariant descriptors for the construction of machine learned functionals. The approach is demonstrated using data from the B3LYP functional on a number of small molecules containing C, H, O, and N along with a neural network regression model. The machine learned functionals are compared to standard physical approximations and the accuracy is assessed for the absolute energy of each molecular system as well as formation energies. The results indicate that it is possible to reproduce the exchange-correlation portion of B3LYP formation energies to within chemical accuracy using orbital-free descriptors with a spatial extent of 0.2 Å. The findings provide empirical insight into the spatial range of electron exchange, and suggest that the combination of convolutional descriptors and machine learning regression models is a promising framework for xc functional design, although challenges remain in obtaining training data and generating models consistent with pseudopotentials.

Research Organization:
Georgia Inst. of Technology, Atlanta, GA (United States)
Sponsoring Organization:
USDOE Office of Science (SC), Basic Energy Sciences (BES) (SC-22)
Grant/Contract Number:
SC0019410
OSTI ID:
1593730
Journal Information:
Physical Review Materials, Journal Name: Physical Review Materials Journal Issue: 6 Vol. 3; ISSN PRMHAR; ISSN 2475-9953
Publisher:
American Physical Society (APS)Copyright Statement
Country of Publication:
United States
Language:
English

References (118)

Accurate description of van der Waals complexes by density functional theory including empirical corrections journal January 2004
Semiempirical GGA-type density functional constructed with a long-range dispersion correction journal January 2006
Machine learning for quantum mechanics in a nutshell journal July 2015
Kinetic-energy-density dependent semilocal exchange-correlation functionals: S journal September 2016
The Nature of Statistical Learning Theory book January 1995
The Nature of Statistical Learning Theory book January 2000
A logical calculus of the ideas immanent in nervous activity journal January 1990
Approximation by superpositions of a sigmoidal function journal December 1989
Approximation by superpositions of a sigmoidal function journal December 1992
A logical calculus of the ideas immanent in nervous activity journal December 1943
Maxwell-Cartesian spherical harmonics in multipole potentials and atomic orbitals journal February 2002
The M06 suite of density functionals for main group thermochemistry, thermochemical kinetics, noncovalent interactions, excited states, and transition elements: two new functionals and systematic testing of four M06-class functionals and 12 other functionals journal July 2007
Implementing the Nelder-Mead simplex algorithm with adaptive parameters journal May 2010
Exchange and correlation in inhomogeneous electron systems journal December 1977
Multilayer feedforward networks are universal approximators journal January 1989
Accurate ab initio energetics of extended systems via explicit correlation embedded in a density functional environment journal October 1998
SPARC: Accurate and efficient finite-difference formulation and parallel implementation of Density Functional Theory: Isolated clusters journal March 2017
SPARC: Accurate and efficient finite-difference formulation and parallel implementation of Density Functional Theory: Extended systems journal July 2017
Development of an exchange–correlation functional with uncertainty quantification capabilities for density functional theory journal April 2016
A logical calculus of the ideas immanent in nervous activity journal January 1990
Machine Learning Methods to Predict Density Functional Theory B3LYP Energies of HOMO and LUMO Orbitals journal December 2016
Big Data Meets Quantum Chemistry Approximations: The Δ-Machine Learning Approach journal April 2015
Kinetic Energy of Hydrocarbons as a Function of Electron Density and Convolutional Neural Networks journal February 2016
Psi4 1.1: An Open-Source Electronic Structure Program Emphasizing Automation, Advanced Libraries, and Interoperability journal June 2017
Improving the Performance of Long-Range-Corrected Exchange-Correlation Functional with an Embedded Neural Network journal September 2017
Machine Learning Predictions of Molecular Properties: Accurate Many-Body Potentials and Nonlocality in Chemical Space journal June 2015
Automatic Differentiation in Quantum Chemistry with Applications to Fully Variational Hartree–Fock journal May 2018
Embedded Correlated Wavefunction Schemes: Theory and Applications journal May 2014
Exchange–Correlation Functional with Good Accuracy for Both Structural and Energetic Properties while Depending Only on the Density and Its Gradient journal June 2012
A Simple, Exact Density-Functional-Theory Embedding Scheme journal July 2012
Density Functional for Spectroscopy:  No Long-Range Self-Interaction Error, Good Performance for Rydberg and Charge-Transfer States, and Better Performance on Average than B3LYP for Ground States journal December 2006
Exchange−Correlation Energy Density from Virial Theorem journal June 1998
Improving the Accuracy of Hybrid Meta-GGA Density Functionals by Range Separation journal October 2011
Bypassing the Kohn-Sham equations with machine learning journal October 2017
A universal strategy for the creation of machine learning-based atomistic force fields journal September 2017
Discovering charge density functionals and structure-property relationships with PROPhet: A general framework for coupling machine learning and first-principles methods journal April 2017
Machine-learned approximations to Density Functional Theory Hamiltonians journal February 2017
MN15: A Kohn–Sham global-hybrid exchange–correlation density functional with broad accuracy for multi-reference and single-reference systems and noncovalent interactions journal January 2016
The TensorMol-0.1 model chemistry: a neural network augmented with long-range physics journal January 2018
Multi-coefficient extrapolated density functional theory for thermochemistry and thermochemical kinetics journal January 2005
Jacob’s ladder of density functional approximations for the exchange-correlation energy conference January 2001
Empirical correction to density functional theory for van der Waals interactions journal January 2002
Hybrid functionals based on a screened Coulomb potential journal May 2003
A real-space model of nondynamical correlation journal August 2003
Meta-generalized gradient approximation: Explanation of a realistic nonempirical density functional journal April 2004
Semiempirical hybrid density functional with perturbative second-order correlation journal January 2006
Influence of the exchange screening parameter on the performance of screened hybrid functionals journal December 2006
Quantum mechanical embedding theory based on a unique embedding potential journal April 2011
Correlation energy of an inhomogeneous electron gas: A coordinate‐space model journal January 1988
Density‐functional thermochemistry. III. The role of exact exchange journal April 1993
Exchange‐correlation potentials journal November 1996
Unambiguous exchange-correlation energy density journal November 1998
mBEEF: An accurate semi-local Bayesian error estimation density functional journal April 2014
Communication: A new class of non-empirical explicit density functionals on the third rung of Jacob’s ladder journal September 2015
Tree based machine learning framework for predicting ground state energies of molecules journal October 2016
Semi-local machine-learned kinetic energy density functional with third-order gradients of electron density journal March 2018
Ab initio theory and modeling of water journal September 2017
Inhomogeneous Electron Gas journal November 1964
Self-Consistent Equations Including Exchange and Correlation Effects journal November 1965
Density-functional exchange-energy approximation with correct asymptotic behavior journal September 1988
From electron densities to Kohn-Sham kinetic energies, orbital energies, exchange-correlation potentials, and exchange-correlation energies journal September 1994
Numerical test of the sixth-order gradient expansion for the kinetic energy:Application to the monovacancy in jellium journal June 1997
van der Waals forces in density functional theory: Perturbational long-range electron-interaction corrections journal July 2005
Deep learning and the Schrödinger equation journal October 2017
Nonlocal approximation to the exchange potential and kinetic energy of an inhomogeneous electron gas journal May 1978
Descriptions of exchange and correlation effects in inhomogeneous electron systems journal October 1979
Accurate and simple density functional for the electronic exchange energy: Generalized gradient approximation journal June 1986
Development of the Colle-Salvetti correlation-energy formula into a functional of the electron density journal January 1988
Erratum: Accurate and simple density functional for the electronic exchange energy: Generalized gradient approximation journal August 1989
Exchange and correlation in silicon journal April 1998
Real-space grid implementation of the projector augmented wave method journal January 2005
Functional designed to include surface effects in self-consistent density functional theory journal August 2005
Laplacian-level density functionals for the kinetic energy density and exchange-correlation energy journal April 2007
Van der Waals density functional: Self-consistent potential and the nature of the van der Waals bond journal September 2007
Dimensional crossover of the exchange-correlation energy at the semilocal level journal October 2008
Density functionals for surface science: Exchange-correlation model development with Bayesian error estimation journal June 2012
Machine-learning approach for one- and two-body corrections to density functional theory: Applications to molecular and condensed water journal August 2013
Semiclassical atom theory applied to solid-state physics journal January 2016
mBEEF-vdW: Robust fitting of error estimation density functionals journal June 2016
Development of a machine learning potential for graphene journal February 2018
Collapse of the Electron Gas to Two Dimensions in Density Functional Theory journal July 2008
Finding Density Functionals with Machine Learning journal June 2012
Density Functionals that Recognize Covalent, Metallic, and Weak Bonds journal September 2013
Easily Implementable Nonlocal Exchange-Correlation Energy Functional journal August 1981
van der Waals Interactions in Density-Functional Theory journal January 1996
Constraint Satisfaction in Local and Gradient Susceptibility Approximations: Application to a van der Waals Density Functional journal March 1996
Generalized Gradient Approximation Made Simple journal October 1996
Generalized Gradient Approximation Made Simple [Phys. Rev. Lett. 77, 3865 (1996)] journal February 1997
Van der Waals Density Functional for General Geometries journal June 2004
The density functional formalism, its applications and prospects journal July 1989
Inhomogeneous Electron Gas journal March 1973
Gradient-based learning applied to document recognition journal January 1998
Face recognition: a convolutional neural-network approach journal January 1997
The Nature Of Statistical Learning Theory~ journal November 1997
Machine learning of accurate energy-conserving molecular force fields journal May 2017
Density functional theory is straying from the path toward the exact functional journal January 2017
Accurate spin-dependent electron liquid correlation energies for local spin density calculations: a critical analysis journal August 1980
ImageNet classification with deep convolutional neural networks journal May 2017
Machine learning of accurate energy-conserving molecular force fields text January 2017
Development of the Colle-Salvetti correlation-energy formula into a functional of the electron density text January 1988
SPARC: Accurate and efficient finite-difference formulation and parallel implementation of Density Functional Theory: Isolated clusters dataset January 2017
SPARC: Accurate and efficient finite-difference formulation and parallel implementation of Density Functional Theory: Extended systems dataset January 2017
Development of a machine learning potential for graphene text January 2018
Collapse of the Electron Gas to Two Dimensions in Density Functional Theory text January 2008
Dimensional crossover of the exchange-correlation energy at the semilocal level text January 2009
Semiclassical atom theory applied to solid-state physics text January 2016
SPARC: Accurate and efficient finite-difference formulation and parallel implementation of Density Functional Theory: Isolated clusters text January 2016
By-passing the Kohn-Sham equations with machine learning text January 2016
Machine-learned approximations to Density Functional Theory Hamiltonians preprint January 2016
Machine Learning of Accurate Energy-Conserving Molecular Force Fields text January 2016
Ab initio theory and modeling of water text January 2017
The TensorMol-0.1 Model Chemistry: a Neural Network Augmented with Long-Range Physics preprint January 2017
Van der Waals forces in density functional theory: perturbational long-range electron interaction corrections text January 2005
Laplacian-level density functionals for the kinetic energy density and exchange-correlation energy text January 2006
Van der Waals density functional: Self-consistent potential and the nature of the van der Waals bond text January 2007
An ultrasensitive molybdenum-based double-heterojunction phototransistor text January 2021
Big Data Meets Quantum Chemistry Approximations: The Δ-Machine Learning Approach text January 2015
Machine Learning Predictions of Molecular Properties: Accurate Many-Body Potentials and Nonlocality in Chemical Space text January 2015

Cited By (1)

Machine-learned electron correlation model based on correlation energy density at complete basis set limit journal July 2019