DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Machine learning for accuracy in density functional approximations

Journal Article · · Journal of Computational Chemistry
DOI: https://doi.org/10.1002/jcc.27366 · OSTI ID:2403662
ORCiD logo [1]
  1. SLAC National Accelerator Laboratory (SLAC), Menlo Park, CA (United States). SUNCAT Center for Interface Science and Catalysis; SLAC

Machine learning techniques have found their way into computational chemistry as indispensable tools to accelerate atomistic simulations and materials design. In addition, machine learning approaches hold the potential to boost the predictive power of computationally efficient electronic structure methods, such as density functional theory, to chemical accuracy and to correct for fundamental errors in density functional approaches. In this paper, recent progress in applying machine learning to improve the accuracy of density functional and related approximations is reviewed. Promises and challenges in devising machine learning models transferable between different chemistries and materials classes are discussed with the help of examples applying promising models to systems far outside their training sets.

Research Organization:
SLAC National Accelerator Laboratory (SLAC), Menlo Park, CA (United States)
Sponsoring Organization:
USDOE Office of Science (SC), Basic Energy Sciences (BES). Chemical Sciences, Geosciences & Biosciences Division (CSGB)
Grant/Contract Number:
AC02-76SF00515
OSTI ID:
2403662
Journal Information:
Journal of Computational Chemistry, Journal Name: Journal of Computational Chemistry Journal Issue: 21 Vol. 45; ISSN 0192-8651
Publisher:
WileyCopyright Statement
Country of Publication:
United States
Language:
English

References (211)

Semiempirical GGA-type density functional constructed with a long-range dispersion correction journal January 2006
Effect of the damping function in dispersion corrected density functional theory journal March 2011
W4-17: A diverse and high-confidence dataset of atomization energies for benchmarking high-level electronic structure methods journal July 2017
MCML : Combining physical constraints with experimental data for a multi‐purpose meta‐generalized gradient approximation journal August 2021
Data‐driven and constrained optimization of semi‐local exchange and nonlocal correlation functionals for materials and surface chemistry journal April 2022
Understanding machine-learned density functionals: Understanding Machine-Learned Density Functionals journal November 2015
Density functional theory applied to the excited states of coordination compounds journal November 1994
Delocalization error: The greatest outstanding challenge in density‐functional theory journal July 2022
Genetic programming as a means for programming computers by natural selection journal June 1994
The M06 suite of density functionals for main group thermochemistry, thermochemical kinetics, noncovalent interactions, excited states, and transition elements: two new functionals and systematic testing of four M06-class functionals and 12 other functionals journal July 2007
Exploring density functional subspaces with genetic algorithms journal December 2018
Combining long-range configuration interaction with short-range density functionals journal August 1997
Optimization algorithm for the generation of ONCV pseudopotentials journal November 2015
W4-11: A high-confidence benchmark dataset for computational thermochemistry derived from first-principles W4 data journal July 2011
Deep Density: Circumventing the Kohn-Sham equations via symmetry preserving neural networks journal October 2021
Inverse Design of Solid-State Materials via a Continuous Representation journal November 2019
A benchmark database for adsorption bond energies to transition metal surfaces and comparison to selected DFT functionals journal October 2015
Status and Challenges of Density Functional Theory journal April 2020
Machine Learning Force Fields journal March 2021
Combining Machine Learning and Computational Chemistry for Predictive Insights Into Chemical Systems journal July 2021
DeePKS: A Comprehensive Data-Driven Approach toward Chemically Accurate Density Functional Theory journal December 2020
A Machine Learning Approach for MP2 Correlation Energies and Its Application to Organic Compounds journal January 2021
CIDER: An Expressive, Nonlocal Feature Set for Machine Learning Density Functionals with Exact Constraints journal March 2022
SBH17: Benchmark Database of Barrier Heights for Dissociative Chemisorption on Transition Metal Surfaces journal December 2022
Low-Data Deep Quantum Chemical Learning for Accurate MP2 and Coupled-Cluster Correlations journal July 2023
Machine Learning Density Functionals from the Random-Phase Approximation journal October 2023
Big Data Meets Quantum Chemistry Approximations: The Δ-Machine Learning Approach journal April 2015
MN15-L: A New Local Exchange-Correlation Functional for Kohn–Sham Density Functional Theory with Broad Accuracy for Atoms, Molecules, and Solids journal February 2016
Nonempirical Meta-Generalized Gradient Approximations for Modeling Chemisorption at Metal Surfaces journal May 2018
Assessment of DFT Methods for Transition Metals with the TMC151 Compilation of Data Sets and Comparison with Accuracies for Main-Group Chemistry journal April 2019
Gaussian Process-Based Refinement of Dispersion Corrections journal October 2019
Bayesian Optimization for Calibrating and Selecting Hybrid-Density Functional Models journal April 2020
Ground State Energy Functional with Hartree–Fock Efficiency and Chemical Accuracy journal August 2020
Improving Density Functional Prediction of Molecular Thermochemical Properties with a Machine-Learning-Corrected Generalized Gradient Approximation journal February 2022
SBH10: A Benchmark Database of Barrier Heights on Transition Metal Surfaces journal September 2017
Accurate and Numerically Efficient r 2 SCAN Meta-Generalized Gradient Approximation journal September 2020
How Well Does Kohn–Sham Regularizer Work for Weakly Correlated Systems? journal March 2022
Uniting Nonempirical and Empirical Density Functional Approximation Strategies Using Constraint-Based Regularization journal July 2022
Computational Quantum Chemistry for Multiple-Site Heisenberg Spin Couplings Made Simple: Still Only One Spin–Flip Required journal May 2015
Transferable Machine-Learning Model of the Electron Density journal December 2018
Enumeration of 166 Billion Organic Small Molecules in the Chemical Universe Database GDB-17 journal November 2012
Finding Nature’s Missing Ternary Oxide Compounds Using Machine Learning and Density Functional Theory journal June 2010
Challenges for Density Functional Theory journal December 2011
Design of Density Functionals by Combining the Method of Constraint Satisfaction with Parametrization for Thermochemistry, Thermochemical Kinetics, and Noncovalent Interactions journal January 2006
S66: A Well-balanced Database of Benchmark Interaction Energies Relevant to Biomolecular Structures journal July 2011
Extensions of the S66 Data Set: More Accurate Interaction Energies and Angular-Displaced Nonequilibrium Geometries journal October 2011
Development of a “First Principles” Water Potential with Flexible Monomers: Dimer Potential Energy Surface, VRT Spectrum, and Second Virial Coefficient journal November 2013
Development of a “First Principles” Water Potential with Flexible Monomers. II: Trimer Potential Energy Surface, Third Virial Coefficient, and Small Clusters journal March 2014
Representative Benchmark Suites for Barrier Heights of Diverse Reaction Types and Assessment of Electronic Structure Methods for Thermochemical Kinetics journal December 2006
Some Fundamental Issues in Ground-State Density Functional Theory: A Guide for the Perplexed journal March 2009
The DBH24/08 Database and Its Use to Assess Electronic Structure Model Chemistries for Chemical Reaction Barrier Heights journal March 2009
Ab Initio Calculation of Vibrational Absorption and Circular Dichroism Spectra Using Density Functional Force Fields journal November 1994
970 Million Druglike Small Molecules for Virtual Screening in the Chemical Universe Database GDB-13 journal July 2009
Benchmark Database of Barrier Heights for Heavy Atom Transfer, Nucleophilic Substitution, Association, and Unimolecular Reactions and Its Use to Test Theoretical Methods journal March 2005
Development and Assessment of a New Hybrid Density Functional Model for Thermochemical Kinetics journal April 2004
Density Functional Theory of Electronic Structure journal January 1996
M11-L: A Local Density Functional That Provides Improved Accuracy for Electronic Structure Calculations in Chemistry and Physics journal December 2011
Learning representations by back-propagating errors journal October 1986
Deep learning journal May 2015
Universal fragment descriptors for predicting properties of inorganic crystals journal June 2017
The Open Quantum Materials Database (OQMD): assessing the accuracy of DFT formation energies journal December 2015
A general-purpose machine learning framework for predicting properties of inorganic materials journal August 2016
Bypassing the Kohn-Sham equations with machine learning journal October 2017
Machine learning accurate exchange and correlation functionals of the electronic density journal July 2020
Retrospective on a decade of machine learning for chemical discovery journal September 2020
Quantum chemical accuracy from density functional approximations via machine learning journal October 2020
Pure non-local machine-learned density functional theory for electron correlation journal January 2021
Machine learning electronic structure methods based on the one-electron reduced density matrix journal October 2023
Deep-learning-based inverse design model for intelligent discovery of organic molecules journal December 2018
Solving the electronic structure problem with machine learning journal February 2019
Recent advances and applications of machine learning in solid-state materials science journal August 2019
Beyond the RPA and GW methods with adiabatic xc-kernels for accurate ground state and quasiparticle energies journal November 2019
Machine learning the Hubbard U parameter in DFT+U using Bayesian optimization journal November 2020
Completing density functional theory by machine learning hidden messages from molecules journal May 2020
Linear Jacobi-Legendre expansion of the charge density for machine learning-accelerated electronic structure calculations journal May 2023
A deep learning framework to emulate density functional theory journal August 2023
SciPy 1.0: fundamental algorithms for scientific computing in Python journal February 2020
Supervised learning of a chemistry functional with damped dispersion journal December 2022
Quantum chemistry structures and properties of 134 kilo molecules journal August 2014
The S66x8 benchmark for noncovalent interactions revisited: explicitly correlated ab initio methods and density functional theory journal January 2016
ANI-1: an extensible neural network potential with DFT accuracy at force field computational cost journal January 2017
A look at the density functional theory zoo with the advanced GMTKN55 database for general main group thermochemistry, kinetics and noncovalent interactions journal January 2017
Electron density learning of non-covalent systems journal January 2019
ωB97X-V: A 10-parameter, range-separated hybrid, generalized gradient approximation density functional with nonlocal correlation, designed by a survival-of-the-fittest strategy journal January 2014
Gaussian-3X (G3X) theory: Use of improved geometries, zero-point energies, and Hartree–Fock basis sets journal January 2001
Emphasizing the exchange-correlation potential in functional development journal March 2001
A long-range correction scheme for generalized-gradient-approximation exchange functionals journal August 2001
A direct optimization method for calculating density functionals and exchange–correlation potentials from electron densities journal January 2003
Hybrid functionals based on a screened Coulomb potential journal May 2003
From ab initio quantum chemistry to molecular dynamics: The delicate case of hydrogen bonding in ammonia journal September 2003
Comparative assessment of a new nonempirical density functional: Molecules and hydrogen-bonded complexes journal December 2003
On the Correlation Problem in Atomic and Molecular Systems. Calculation of Wavefunction Components in Ursell‐Type Expansion Using Quantum‐Field Theoretical Methods journal December 1966
Effect of the Perdew–Zunger self-interaction correction on the thermochemical performance of approximate density functionals journal January 2004
Assessment of Gaussian-3 and density-functional theories on the G3/05 test set of experimental energies journal September 2005
A density-functional model of the dispersion interaction journal October 2005
Exchange-correlation functional with broad accuracy for metallic and nonmetallic compounds, kinetics, and noncovalent interactions journal October 2005
Erratum: “Hybrid functionals based on a screened Coulomb potential” [J. Chem. Phys. 118, 8207 (2003)] journal June 2006
W4 theory for computational thermochemistry: In pursuit of confident sub-kJ/mol predictions journal October 2006
A new local density functional for main-group thermochemistry, transition metal bonding, thermochemical kinetics, and noncovalent interactions journal November 2006
Many-electron self-interaction error in approximate density functionals journal November 2006
Gaussian-4 theory journal February 2007
Basis set convergence of post-CCSD contributions to molecular atomization energies journal August 2007
Gaussian-4 theory using reduced order perturbation theory journal September 2007
Density functional method including weak interactions: Dispersion coefficients based on the local response approximation journal December 2009
Hybrid functionals including random phase approximation correlation and second-order screened exchange journal March 2010
A consistent and accurate ab initio parametrization of density functional dispersion correction (DFT-D) for the 94 elements H-Pu journal April 2010
Nonlocal van der Waals density functional: The simpler the better journal December 2010
A generalized-gradient approximation exchange hole model for dispersion coefficients journal January 2011
Valence bond description of antiferromagnetic coupling in transition metal dimers journal May 1981
Gaussian‐2 theory for molecular energies of first‐ and second‐row compounds journal June 1991
A new mixing of Hartree–Fock and local density‐functional theories journal January 1993
Density‐functional thermochemistry. III. The role of exact exchange journal April 1993
Perspective on density functional theory journal April 2012
Exchange‐correlation potentials journal November 1996
Density-functional thermochemistry. V. Systematic optimization of exchange-correlation functionals journal November 1997
Development and assessment of new exchange-correlation functionals journal October 1998
Gaussian-3 (G3) theory for molecules containing first and second-row atoms journal November 1998
New generalized gradient approximation functionals journal January 2000
Commentary: The Materials Project: A materials genome approach to accelerating materials innovation journal July 2013
Assessment of Gaussian-3 and density functional theories for a larger experimental test set journal May 2000
Perspective: Fifty years of density-functional theory in chemical physics journal May 2014
mBEEF: An accurate semi-local Bayesian error estimation density functional journal April 2014
Gedanken densities and exact constraints in density functional theory journal May 2014
SchNet – A deep learning architecture for molecules and materials journal June 2018
A universal density matrix functional from molecular orbital-based machine learning: Transferability across organic molecules journal April 2019
A generally applicable atomic-charge dependent London dispersion correction journal April 2019
Learning from the density to correct total energy and forces in first principle simulations journal October 2019
QMCPACK: Advances in the development, efficiency, and application of auxiliary field and real-space variational and diffusion quantum Monte Carlo journal May 2020
DQC: A Python program package for differentiable quantum chemistry journal February 2022
Density-functional theory vs density-functional fits journal June 2022
What is the optimal mGGA exchange functional for solids? journal September 2022
Many recent density functionals are numerically ill-behaved journal November 2022
The fourth-order expansion of the exchange hole and neural networks to construct exchange–correlation functionals journal November 2022
Automatic differentiation for orbital-free density functional theory journal March 2023
A semilocal machine-learning correction to density functional approximations journal April 2023
Revised M06-L functional for improved accuracy on chemical reaction barrier heights, noncovalent interactions, and solid-state physics journal July 2017
M06-SX screened-exchange density functional for chemistry and solid-state physics journal January 2020
Thirty years of density functional theory in computational chemistry: an overview and extensive assessment of 200 density functionals journal April 2017
Ridge Regression: Biased Estimation for Nonorthogonal Problems journal February 1970
QUANTUM ESPRESSO: a modular and open-source software project for quantum simulations of materials journal September 2009
Wannier90 as a community code: new features and applications journal January 2020
Machine learning of molecular electronic properties in chemical compound space journal September 2013
Performance of various density-functional approximations for cohesive properties of 64 bulk solids journal June 2018
Machine learning the derivative discontinuity of density-functional theory journal December 2021
Inhomogeneous Electron Gas journal November 1964
New Method for Calculating the One-Particle Green's Function with Application to the Electron-Gas Problem journal August 1965
Note on an Approximation Treatment for Many-Electron Systems journal October 1934
A Collective Description of Electron Interactions. I. Magnetic Interactions journal June 1951
From electron densities to Kohn-Sham kinetic energies, orbital energies, exchange-correlation potentials, and exchange-correlation energies journal September 1994
Fourth-order series expansion of the exchange hole journal August 2017
Adsorption on transition metal surfaces: Transferability and accuracy of DFT using the ADS41 dataset journal July 2019
Analysis of over-magnetization of elemental transition metal solids from the SCAN density functional journal July 2019
Exchange and correlation in atoms, molecules, and solids by the spin-density-functional formalism journal May 1976
Self-interaction correction to density-functional approximations for many-electron systems journal May 1981
Self-consistent Hartree-Fock and screened-exchange calculations in solids: Application to silicon journal September 1986
Electron correlation in semiconductors and insulators: Band gaps and quasiparticle energies journal October 1986
Development of the Colle-Salvetti correlation-energy formula into a functional of the electron density journal January 1988
Band theory and Mott insulators: Hubbard U instead of Stoner I journal July 1991
Accurate and simple analytic representation of the electron-gas correlation energy journal June 1992
Local-density functional and on-site correlations: The electronic structure of La 2 CuO 4 and LaCuO 3 journal May 1994
Projector augmented-wave method journal December 1994
Density-functional theory and strong interactions: Orbital ordering in Mott-Hubbard insulators journal August 1995
Efficient iterative schemes for ab initio total-energy calculations using a plane-wave basis set journal October 1996
From ultrasoft pseudopotentials to the projector augmented-wave method journal January 1999
Improved adsorption energetics within density-functional theory using revised Perdew-Burke-Ernzerhof functionals journal March 1999
Energy and pressure versus volume: Equations of state motivated by the stabilized jellium model journal May 2001
Linear response approach to the calculation of the effective interaction parameters in the LDA + U method journal January 2005
Oxidation energies of transition metal oxides within the GGA + U framework journal May 2006
More accurate generalized gradient approximation for solids journal June 2006
Kohn-Sham potential with discontinuity for band gap materials journal September 2010
Formation enthalpies by mixing GGA and GGA + U calculations journal July 2011
Lattice constants from semilocal density functionals with zero-point phonon correction journal January 2012
Density functionals for surface science: Exchange-correlation model development with Bayesian error estimation journal June 2012
Optimized norm-conserving Vanderbilt pseudopotentials journal August 2013
mBEEF-vdW: Robust fitting of error estimation density functionals journal June 2016
Efficient and accurate machine-learning interpolation of atomic energies in compositions with many species journal July 2017
Hybrid functional pseudopotentials journal February 2018
Deorbitalized meta-GGA exchange-correlation functionals in solids journal September 2018
Restoring the Density-Gradient Expansion for Exchange in Solids and Surfaces journal April 2008
Localization and Delocalization Errors in Density Functional Theory and Implications for Band-Gap Prediction journal April 2008
Accurate Molecular Van Der Waals Interactions from Ground-State Electron Density and Free-Atom Reference Data journal February 2009
Gaussian Approximation Potentials: The Accuracy of Quantum Mechanics, without the Electrons journal April 2010
Finding Density Functionals with Machine Learning journal June 2012
Strongly Constrained and Appropriately Normed Semilocal Density Functional journal July 2015
Crystal Graph Convolutional Neural Networks for an Accurate and Interpretable Prediction of Material Properties journal April 2018
Kohn-Sham Equations as Regularizer: Building Prior Knowledge into Machine-Learned Physics journal January 2021
Learning the Exchange-Correlation Functional from Nature with Fully Differentiable Density Functional Theory journal September 2021
Discovering Quantum Phase Transitions with Fermionic Neural Networks journal January 2023
Ground State of the Electron Gas by a Stochastic Method journal August 1980
Density-Functional Theory for Fractional Particle Number: Derivative Discontinuities of the Energy journal December 1982
Accurate Density Functional for the Energy: Real-Space Cutoff of the Gradient Expansion for the Exchange Hole journal October 1985
Theory of quasiparticle energies in alkali metals journal August 1987
Density matrix formulation for quantum renormalization groups journal November 1992
van der Waals Interactions in Density-Functional Theory journal January 1996
Generalized Gradient Approximation Made Simple journal October 1996
Comment on “Generalized Gradient Approximation Made Simple” journal January 1998
Climbing the Density Functional Ladder: Nonempirical Meta–Generalized Gradient Approximation Designed for Molecules and Solids journal September 2003
Van der Waals Density Functional for General Geometries journal June 2004
Generalized Neural-Network Representation of High-Dimensional Potential-Energy Surfaces journal April 2007
Design and analysis of machine learning exchange-correlation functionals via rotationally invariant convolutional descriptors journal June 2019
Laplacian-level meta-generalized gradient approximation for solid and liquid metals journal August 2022
Machine-learning-based exchange correlation functional with physical asymptotic constraints journal February 2022
Machine learning of accurate energy-conserving molecular force fields journal May 2017
Evolving symbolic density functionals journal September 2022
Density functional theory is straying from the path toward the exact functional journal January 2017
A conundrum for density functional theory journal January 2017
XGBoost: A Scalable Tree Boosting System conference January 2016
The Predictive Power of Exact Constraints and Appropriate Norms in Density Functional Theory journal January 2023
Prediction Games and Arcing Algorithms journal October 1999
machine. journal October 2001
Regularized Evolution for Image Classifier Architecture Search journal July 2019