DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: DeePKS: A Comprehensive Data-Driven Approach toward Chemically Accurate Density Functional Theory

Abstract

We propose a general machine learning-based framework for building an accurate and widely applicable energy functional within the framework of generalized Kohn–Sham density functional theory. To this end, we develop a way of training self-consistent models that are capable of taking large datasets from different systems and different kinds of labels. Here, we demonstrate that the functional that results from this training procedure gives chemically accurate predictions on energy, force, dipole, and electron density for a large class of molecules. It can be continuously improved when more and more data are available.

Authors:
ORCiD logo [1]; ORCiD logo [1]; ORCiD logo [2];  [1]
  1. Princeton University, NJ (United States)
  2. Institute of Applied Physics and Computational Mathematics, Beijing (China)
Publication Date:
Research Org.:
Princeton Univ., NJ (United States)
Sponsoring Org.:
USDOE; National Science Foundation of China; National Key Research and Development Program of China
OSTI Identifier:
1999126
Grant/Contract Number:  
SC0019394; N00014-13-1-0338; 11871110; 2016YFB0201200; 2016YFB0201203
Resource Type:
Accepted Manuscript
Journal Name:
Journal of Chemical Theory and Computation
Additional Journal Information:
Journal Volume: 17; Journal Issue: 1; Journal ID: ISSN 1549-9618
Publisher:
American Chemical Society
Country of Publication:
United States
Language:
English
Subject:
37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CHEMISTRY; Aromatic compounds; Density functional theory; Energy; Hydrocarbons; Molecules

Citation Formats

Chen, Yixiao, Zhang, Linfeng, Wang, Han, and E, Weinan. DeePKS: A Comprehensive Data-Driven Approach toward Chemically Accurate Density Functional Theory. United States: N. p., 2020. Web. doi:10.1021/acs.jctc.0c00872.
Chen, Yixiao, Zhang, Linfeng, Wang, Han, & E, Weinan. DeePKS: A Comprehensive Data-Driven Approach toward Chemically Accurate Density Functional Theory. United States. https://doi.org/10.1021/acs.jctc.0c00872
Chen, Yixiao, Zhang, Linfeng, Wang, Han, and E, Weinan. Wed . "DeePKS: A Comprehensive Data-Driven Approach toward Chemically Accurate Density Functional Theory". United States. https://doi.org/10.1021/acs.jctc.0c00872. https://www.osti.gov/servlets/purl/1999126.
@article{osti_1999126,
title = {DeePKS: A Comprehensive Data-Driven Approach toward Chemically Accurate Density Functional Theory},
author = {Chen, Yixiao and Zhang, Linfeng and Wang, Han and E, Weinan},
abstractNote = {We propose a general machine learning-based framework for building an accurate and widely applicable energy functional within the framework of generalized Kohn–Sham density functional theory. To this end, we develop a way of training self-consistent models that are capable of taking large datasets from different systems and different kinds of labels. Here, we demonstrate that the functional that results from this training procedure gives chemically accurate predictions on energy, force, dipole, and electron density for a large class of molecules. It can be continuously improved when more and more data are available.},
doi = {10.1021/acs.jctc.0c00872},
journal = {Journal of Chemical Theory and Computation},
number = 1,
volume = 17,
place = {United States},
year = {Wed Dec 09 00:00:00 EST 2020},
month = {Wed Dec 09 00:00:00 EST 2020}
}

Works referenced in this record:

Generalized Gradient Approximation Made Simple
journal, October 1996

  • Perdew, John P.; Burke, Kieron; Ernzerhof, Matthias
  • Physical Review Letters, Vol. 77, Issue 18, p. 3865-3868
  • DOI: 10.1103/PhysRevLett.77.3865

Fast and Accurate Modeling of Molecular Atomization Energies with Machine Learning
journal, January 2012


Ground State Energy Functional with Hartree–Fock Efficiency and Chemical Accuracy
journal, August 2020

  • Chen, Yixiao; Zhang, Linfeng; Wang, Han
  • The Journal of Physical Chemistry A, Vol. 124, Issue 35
  • DOI: 10.1021/acs.jpca.0c03886

Quadratic configuration interaction. A general technique for determining electron correlation energies
journal, November 1987

  • Pople, John A.; Head‐Gordon, Martin; Raghavachari, Krishnan
  • The Journal of Chemical Physics, Vol. 87, Issue 10
  • DOI: 10.1063/1.453520

Finding Density Functionals with Machine Learning
journal, June 2012


Improving the Performance of Long-Range-Corrected Exchange-Correlation Functional with an Embedded Neural Network
journal, September 2017

  • Liu, Qin; Wang, JingChun; Du, PengLi
  • The Journal of Physical Chemistry A, Vol. 121, Issue 38
  • DOI: 10.1021/acs.jpca.7b07045

P y SCF: the Python-based simulations of chemistry framework : The PySCF program
journal, September 2017

  • Sun, Qiming; Berkelbach, Timothy C.; Blunt, Nick S.
  • Wiley Interdisciplinary Reviews: Computational Molecular Science, Vol. 8, Issue 1
  • DOI: 10.1002/wcms.1340

ANI-1: an extensible neural network potential with DFT accuracy at force field computational cost
journal, January 2017

  • Smith, J. S.; Isayev, O.; Roitberg, A. E.
  • Chemical Science, Vol. 8, Issue 4
  • DOI: 10.1039/C6SC05720A

Approaching coupled cluster accuracy with a general-purpose neural network potential through transfer learning
journal, July 2019


FCHL revisited: Faster and more accurate quantum machine learning
journal, January 2020

  • Christensen, Anders S.; Bratholm, Lars A.; Faber, Felix A.
  • The Journal of Chemical Physics, Vol. 152, Issue 4
  • DOI: 10.1063/1.5126701

Generalized Gradient Approximation That Recovers the Second-Order Density-Gradient Expansion with Optimized Across-the-Board Performance
journal, July 2011

  • Peverati, Roberto; Zhao, Yan; Truhlar, Donald G.
  • The Journal of Physical Chemistry Letters, Vol. 2, Issue 16
  • DOI: 10.1021/jz200616w

Big Data Meets Quantum Chemistry Approximations: The Δ-Machine Learning Approach
journal, April 2015

  • Ramakrishnan, Raghunathan; Dral, Pavlo O.; Rupp, Matthias
  • Journal of Chemical Theory and Computation, Vol. 11, Issue 5
  • DOI: 10.1021/acs.jctc.5b00099

Solving many-electron Schrödinger equation using deep neural networks
journal, December 2019


Density functionals for coulomb systems
journal, September 1983

  • Lieb, Elliott H.
  • International Journal of Quantum Chemistry, Vol. 24, Issue 3
  • DOI: 10.1002/qua.560240302

Coupled-cluster method for multideterminantal reference states
journal, October 1981


Bypassing the Kohn-Sham equations with machine learning
journal, October 2017


Less is more: Sampling chemical space with active learning
journal, June 2018

  • Smith, Justin S.; Nebgen, Ben; Lubbers, Nicholas
  • The Journal of Chemical Physics, Vol. 148, Issue 24
  • DOI: 10.1063/1.5023802

VESTA 3 for three-dimensional visualization of crystal, volumetric and morphology data
journal, October 2011


Inhomogeneous Electron Gas
journal, November 1964


Generalized Neural-Network Representation of High-Dimensional Potential-Energy Surfaces
journal, April 2007


Visualization and analysis of atomistic simulation data with OVITO–the Open Visualization Tool
journal, December 2009


Machine learning accurate exchange and correlation functionals of the electronic density
journal, July 2020


A universal density matrix functional from molecular orbital-based machine learning: Transferability across organic molecules
journal, April 2019

  • Cheng, Lixue; Welborn, Matthew; Christensen, Anders S.
  • The Journal of Chemical Physics, Vol. 150, Issue 13
  • DOI: 10.1063/1.5088393

Gaussian Approximation Potentials: The Accuracy of Quantum Mechanics, without the Electrons
journal, April 2010


Hohenberg-Kohn theorem for nonlocal external potentials
journal, September 1975


Transferable Machine-Learning Model of the Electron Density
journal, December 2018


Regression Clustering for Improved Accuracy and Training Costs with Molecular-Orbital-Based Machine Learning
journal, October 2019

  • Cheng, Lixue; Kovachki, Nikola B.; Welborn, Matthew
  • Journal of Chemical Theory and Computation, Vol. 15, Issue 12
  • DOI: 10.1021/acs.jctc.9b00884

Solving the electronic structure problem with machine learning
journal, February 2019

  • Chandrasekaran, Anand; Kamal, Deepak; Batra, Rohit
  • npj Computational Materials, Vol. 5, Issue 1
  • DOI: 10.1038/s41524-019-0162-7

Note on an Approximation Treatment for Many-Electron Systems
journal, October 1934


Machine learning of accurate energy-conserving molecular force fields
journal, May 2017

  • Chmiela, Stefan; Tkatchenko, Alexandre; Sauceda, Huziel E.
  • Science Advances, Vol. 3, Issue 5
  • DOI: 10.1126/sciadv.1603015

Ab initio solution of the many-electron Schrödinger equation with deep neural networks
journal, September 2020


Deep-neural-network solution of the electronic Schrödinger equation
journal, September 2020


Deep Potential Molecular Dynamics: A Scalable Model with the Accuracy of Quantum Mechanics
journal, April 2018


machine.
journal, October 2001


Strongly Constrained and Appropriately Normed Semilocal Density Functional
journal, July 2015


Validation of electronic structure methods for isomerization reactions of large organic molecules
journal, January 2011

  • Luo, Sijie; Zhao, Yan; Truhlar, Donald G.
  • Physical Chemistry Chemical Physics, Vol. 13, Issue 30
  • DOI: 10.1039/c1cp20834a

Self-Consistent Equations Including Exchange and Correlation Effects
journal, November 1965


Completing density functional theory by machine learning hidden messages from molecules
journal, May 2020


Molecular force fields with gradient-domain machine learning: Construction and application to dynamics of small molecules with coupled cluster forces
journal, March 2019

  • Sauceda, Huziel E.; Chmiela, Stefan; Poltavsky, Igor
  • The Journal of Chemical Physics, Vol. 150, Issue 11
  • DOI: 10.1063/1.5078687

Generalized Kohn-Sham schemes and the band-gap problem
journal, February 1996