SQDFT: Spectral Quadrature method for largescale parallel $\mathcal{O}\left(N\right)$ Kohn–Sham calculations at high temperature
Abstract
We present SQDFT: a largescale parallel implementation of the Spectral Quadrature (SQ) method for $$\mathscr{O}(N)$$ Kohn–Sham Density Functional Theory (DFT) calculations at high temperature. Specifically, we develop an efficient and scalable finitedifference implementation of the infinitecell Clenshaw–Curtis SQ approach, in which results for the infinite crystal are obtained by expressing quantities of interest as bilinear forms or sums of bilinear forms, that are then approximated by spatially localized Clenshaw–Curtis quadrature rules. We demonstrate the accuracy of SQDFT by showing systematic convergence of energies and atomic forces with respect to SQ parameters to reference diagonalization results, and convergence with discretization to established planewave results, for both metallic and insulating systems. Here, we further demonstrate that SQDFT achieves excellent strong and weak parallel scaling on computer systems consisting of tens of thousands of processors, with near perfect $$\mathscr{O}(N)$$ scaling with system size and wall times as low as a few seconds per selfconsistent field iteration. Finally, we verify the accuracy of SQDFT in largescale quantum molecular dynamics simulations of aluminum at high temperature.
 Authors:

 Georgia Inst. of Technology, Atlanta, GA (United States). College of Engineering
 Lawrence Livermore National Lab. (LLNL), Livermore, CA (United States). Physics Division
 Publication Date:
 Research Org.:
 Lawrence Livermore National Lab. (LLNL), Livermore, CA (United States)
 Sponsoring Org.:
 National Science Foundation (NSF); USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR)
 OSTI Identifier:
 1438771
 Alternate Identifier(s):
 OSTI ID: 1691846
 Report Number(s):
 LLNLJRNL738006
Journal ID: ISSN 00104655; TRN: US1900520
 Grant/Contract Number:
 AC5207NA27344; 1333500
 Resource Type:
 Accepted Manuscript
 Journal Name:
 Computer Physics Communications
 Additional Journal Information:
 Journal Volume: 224; Journal Issue: C; Journal ID: ISSN 00104655
 Publisher:
 Elsevier
 Country of Publication:
 United States
 Language:
 English
 Subject:
 75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND SUPERFLUIDITY; 97 MATHEMATICS AND COMPUTING
Citation Formats
Suryanarayana, Phanish, Pratapa, Phanisri P., Sharma, Abhiraj, and Pask, John E. SQDFT: Spectral Quadrature method for largescale parallel O(N) Kohn–Sham calculations at high temperature. United States: N. p., 2017.
Web. https://doi.org/10.1016/j.cpc.2017.12.003.
Suryanarayana, Phanish, Pratapa, Phanisri P., Sharma, Abhiraj, & Pask, John E. SQDFT: Spectral Quadrature method for largescale parallel O(N) Kohn–Sham calculations at high temperature. United States. https://doi.org/10.1016/j.cpc.2017.12.003
Suryanarayana, Phanish, Pratapa, Phanisri P., Sharma, Abhiraj, and Pask, John E. Thu .
"SQDFT: Spectral Quadrature method for largescale parallel O(N) Kohn–Sham calculations at high temperature". United States. https://doi.org/10.1016/j.cpc.2017.12.003. https://www.osti.gov/servlets/purl/1438771.
@article{osti_1438771,
title = {SQDFT: Spectral Quadrature method for largescale parallel O(N) Kohn–Sham calculations at high temperature},
author = {Suryanarayana, Phanish and Pratapa, Phanisri P. and Sharma, Abhiraj and Pask, John E.},
abstractNote = {We present SQDFT: a largescale parallel implementation of the Spectral Quadrature (SQ) method for $\mathscr{O}(N)$ Kohn–Sham Density Functional Theory (DFT) calculations at high temperature. Specifically, we develop an efficient and scalable finitedifference implementation of the infinitecell Clenshaw–Curtis SQ approach, in which results for the infinite crystal are obtained by expressing quantities of interest as bilinear forms or sums of bilinear forms, that are then approximated by spatially localized Clenshaw–Curtis quadrature rules. We demonstrate the accuracy of SQDFT by showing systematic convergence of energies and atomic forces with respect to SQ parameters to reference diagonalization results, and convergence with discretization to established planewave results, for both metallic and insulating systems. Here, we further demonstrate that SQDFT achieves excellent strong and weak parallel scaling on computer systems consisting of tens of thousands of processors, with near perfect $\mathscr{O}(N)$ scaling with system size and wall times as low as a few seconds per selfconsistent field iteration. Finally, we verify the accuracy of SQDFT in largescale quantum molecular dynamics simulations of aluminum at high temperature.},
doi = {10.1016/j.cpc.2017.12.003},
journal = {Computer Physics Communications},
number = C,
volume = 224,
place = {United States},
year = {2017},
month = {12}
}
Web of Science
Figures / Tables:
Works referenced in this record:
Inhomogeneous Electron Gas
journal, November 1964
 Hohenberg, P.; Kohn, W.
 Physical Review, Vol. 136, Issue 3B, p. B864B871
SelfConsistent Equations Including Exchange and Correlation Effects
journal, November 1965
 Kohn, W.; Sham, L. J.
 Physical Review, Vol. 140, Issue 4A, p. A1133A1138
Linear scaling electronic structure methods
journal, July 1999
 Goedecker, Stefan
 Reviews of Modern Physics, Vol. 71, Issue 4
\mathcal{O}(N) methods in electronic structure calculations
journal, February 2012
 Bowler, D. R.; Miyazaki, T.
 Reports on Progress in Physics, Vol. 75, Issue 3
Perspective: Methods for largescale density functional calculations on metallic systems
journal, December 2016
 Aarons, Jolyon; Sarwar, Misbah; Thompsett, David
 The Journal of Chemical Physics, Vol. 145, Issue 22
Ab initiomolecular dynamics for liquid metals
journal, January 1993
 Kresse, G.; Hafner, J.
 Physical Review B, Vol. 47, Issue 1, p. 558561
Decay properties of the finitetemperature density matrix in metals
journal, August 1998
 Goedecker, S.
 Physical Review B, Vol. 58, Issue 7
Locality of the Density Matrix in Metals, Semiconductors, and Insulators
journal, March 1999
 IsmailBeigi, Sohrab; Arias, T. A.
 Physical Review Letters, Vol. 82, Issue 10
Properties of the density matrix from realistic calculations
journal, May 2001
 Zhang, Xiaodong; Drabold, D. A.
 Physical Review B, Vol. 63, Issue 23
Spatial decay of the singleparticle density matrix in tightbinding metals: Analytic results in two dimensions
journal, December 2002
 Taraskin, S. N.; Fry, P. A.; Zhang, Xiaodong
 Physical Review B, Vol. 66, Issue 23
Decay Properties of Spectral Projectors with Applications to Electronic Structure
journal, January 2013
 Benzi, Michele; Boito, Paola; Razouk, Nader
 SIAM Review, Vol. 55, Issue 1
OrderN firstprinciples calculations with the conquest code
journal, July 2007
 Gillan, M. J.; Bowler, D. R.; Torralba, A. S.
 Computer Physics Communications, Vol. 177, Issue 12
Introducing ONETEP : Linearscaling density functional simulations on parallel computers
journal, February 2005
 Skylaris, ChrisKriton; Haynes, Peter D.; Mostofi, Arash A.
 The Journal of Chemical Physics, Vol. 122, Issue 8
Augmented Orbital Minimization Method for Linear Scaling Electronic Structure Calculations
journal, March 2007
 Tsuchida, Eiji
 Journal of the Physical Society of Japan, Vol. 76, Issue 3
Accurate and Scalable $O(N)$ Algorithm for FirstPrinciples MolecularDynamics Computations on Large Parallel Computers
journal, January 2014
 OseiKuffuor, Daniel; Fattebert, JeanLuc
 Physical Review Letters, Vol. 112, Issue 4
Daubechies wavelets for linear scaling density functional theory
journal, May 2014
 Mohr, Stephan; Ratcliff, Laura E.; Boulanger, Paul
 The Journal of Chemical Physics, Vol. 140, Issue 20
Pulay forces from localized orbitals optimized in situ using a psinc basis set
journal, June 2012
 RuizSerrano, Álvaro; Hine, Nicholas D. M.; Skylaris, ChrisKriton
 The Journal of Chemical Physics, Vol. 136, Issue 23
Largescale molecular dynamics simulations of dense plasmas: The Cimarron Project
journal, March 2012
 Graziani, Frank R.; Batista, Victor S.; Benedict, Lorin X.
 High Energy Density Physics, Vol. 8, Issue 1
Aluminum EquationofState Data in the Warm Dense Matter Regime
journal, August 2003
 Renaudin, P.; Blancard, C.; Clérouin, J.
 Physical Review Letters, Vol. 91, Issue 7
Static and dynamic conductivity of warm dense matter within a densityfunctional approach: Application to aluminum and gold
journal, March 2006
 Dharmawardana, M. W. C.
 Physical Review E, Vol. 73, Issue 3
The Formation of Warm Dense Matter: Experimental Evidence for Electronic Bond Hardening in Gold
journal, February 2009
 Ernstorfer, R.; Harb, M.; Hebeisen, C. T.
 Science, Vol. 323, Issue 5917
OrbitalFree DensityFunctional Theory Simulations of the Dynamic Structure Factor of Warm Dense Aluminum
journal, October 2013
 White, T. G.; Richardson, S.; Crowley, B. J. B.
 Physical Review Letters, Vol. 111, Issue 17
Veryhightemperature molecular dynamics
journal, January 2006
 Lambert, Flavien; Clérouin, Jean; Zérah, Gilles
 Physical Review E, Vol. 73, Issue 1
Extended application of KohnSham firstprinciples molecular dynamics method with plane wave approximation at high energy—From cold materials to hot dense plasmas
journal, April 2016
 Zhang, Shen; Wang, Hongwei; Kang, Wei
 Physics of Plasmas, Vol. 23, Issue 4
Efficient formalism for warm dense matter simulations
journal, October 2015
 Cangi, Attila; PribramJones, Aurora
 Physical Review B, Vol. 92, Issue 16
On spectral quadrature for linearscaling Density Functional Theory
journal, October 2013
 Suryanarayana, Phanish
 Chemical Physics Letters, Vol. 584
Spectral Quadrature method for accurate $\mathcal{O}\left(N\right)$ electronic structure calculations of metals and insulators
journal, March 2016
 Pratapa, Phanisri P.; Suryanarayana, Phanish; Pask, John E.
 Computer Physics Communications, Vol. 200
Nearsightedness of electronic matter
journal, August 2005
 Prodan, E.; Kohn, W.
 Proceedings of the National Academy of Sciences, Vol. 102, Issue 33
Existence of minimizers for Kohn–Sham models in quantum chemistry
journal, November 2009
 Anantharaman, Arnaud; Cancès, Eric
 Annales de l'Institut Henri Poincare (C) Non Linear Analysis, Vol. 26, Issue 6
Realspace formulation of the electrostatic potential and total energy of solids
journal, March 2005
 Pask, J. E.; Sterne, P. A.
 Physical Review B, Vol. 71, Issue 11
Nonperiodic finiteelement formulation of orbitalfree density functional theory
journal, April 2007
 Gavini, Vikram; Knap, Jaroslaw; Bhattacharya, Kaushik
 Journal of the Mechanics and Physics of Solids, Vol. 55, Issue 4
Nonperiodic finiteelement formulation of Kohn–Sham density functional theory
journal, February 2010
 Suryanarayana, Phanish; Gavini, Vikram; Blesgen, Thomas
 Journal of the Mechanics and Physics of Solids, Vol. 58, Issue 2
A meshfree convex approximation scheme for Kohn–Sham density functional theory
journal, June 2011
 Suryanarayana, Phanish; Bhattacharya, Kaushik; Ortiz, Michael
 Journal of Computational Physics, Vol. 230, Issue 13
Augmented Lagrangian formulation of orbitalfree density functional theory
journal, October 2014
 Suryanarayana, Phanish; Phanish, Deepa
 Journal of Computational Physics, Vol. 275
Higherorder finitedifference formulation of periodic Orbitalfree Density Functional Theory
journal, February 2016
 Ghosh, Swarnava; Suryanarayana, Phanish
 Journal of Computational Physics, Vol. 307
Achieving plane wave accuracy in linearscaling density functional theory applied to periodic systems: A case study on crystalline silicon
journal, October 2007
 Skylaris, ChrisKriton; Haynes, Peter D.
 The Journal of Chemical Physics, Vol. 127, Issue 16
On nearsightedness in metallic systems for $\mathcal{O}(N)$ Density Functional Theory calculations: A case study on aluminum
journal, July 2017
 Suryanarayana, Phanish
 Chemical Physics Letters, Vol. 679
Coarsegraining Kohn–Sham Density Functional Theory
journal, January 2013
 Suryanarayana, Phanish; Bhattacharya, Kaushik; Ortiz, Michael
 Journal of the Mechanics and Physics of Solids, Vol. 61, Issue 1
Elliptic Preconditioner for Accelerating the SelfConsistent Field Iteration in KohnSham Density Functional Theory
journal, January 2013
 Lin, Lin; Yang, Chao
 SIAM Journal on Scientific Computing, Vol. 35, Issue 5
Periodic Pulay method for robust and efficient convergence acceleration of selfconsistent field iterations
journal, March 2016
 Banerjee, Amartya S.; Suryanarayana, Phanish; Pask, John E.
 Chemical Physics Letters, Vol. 647
Iterative Procedures for Nonlinear Integral Equations
journal, October 1965
 Anderson, Donald G.
 Journal of the ACM, Vol. 12, Issue 4
Convergence acceleration of iterative sequences. the case of scf iteration
journal, July 1980
 Pulay, Péter
 Chemical Physics Letters, Vol. 73, Issue 2
Anderson acceleration of the Jacobi iterative method: An efficient alternative to Krylov methods for large, sparse linear systems
journal, February 2016
 Pratapa, Phanisri P.; Suryanarayana, Phanish; Pask, John E.
 Journal of Computational Physics, Vol. 306
Ab initio molecular dynamics, a simple algorithm for charge extrapolation
journal, April 1999
 Alfè, Dario
 Computer Physics Communications, Vol. 118, Issue 1
SPARC: Accurate and efficient finitedifference formulation and parallel implementation of Density Functional Theory: Extended systems
journal, July 2017
 Ghosh, Swarnava; Suryanarayana, Phanish
 Computer Physics Communications, Vol. 216
SPARC: Accurate and efficient finitedifference formulation and parallel implementation of Density Functional Theory: Isolated clusters
journal, March 2017
 Ghosh, Swarnava; Suryanarayana, Phanish
 Computer Physics Communications, Vol. 212
On numerically predicting the onset and mode of instability in atomistic systems
journal, December 2016
 Pratapa, Phanisri P.; Suryanarayana, Phanish
 Mechanics Research Communications, Vol. 78
Tightbinding electronicstructure calculations and tightbinding molecular dynamics with localized orbitals
journal, April 1995
 Goedecker, S.; Teter, M.
 Physical Review B, Vol. 51, Issue 15
Efficient Linear Scaling Algorithm for TightBinding Molecular Dynamics
journal, July 1994
 Goedecker, S.; Colombo, L.
 Physical Review Letters, Vol. 73, Issue 1
Efficient pseudopotentials for planewave calculations
journal, January 1991
 Troullier, N.; Martins, José Luriaas
 Physical Review B, Vol. 43, Issue 3
Accurate and simple analytic representation of the electrongas correlation energy
journal, June 1992
 Perdew, John P.; Wang, Yue
 Physical Review B, Vol. 45, Issue 23, p. 1324413249
Ground State of the Electron Gas by a Stochastic Method
journal, August 1980
 Ceperley, D. M.; Alder, B. J.
 Physical Review Letters, Vol. 45, Issue 7, p. 566569
Firstprinciples computation of material properties: the ABINIT software project
journal, November 2002
 Gonze, X.; Beuken, J. M.; Caracas, R.
 Computational Materials Science, Vol. 25, Issue 3
Timesaving DoubleGrid Method for RealSpace ElectronicStructure Calculations
journal, June 1999
 Ono, Tomoya; Hirose, Kikuji
 Physical Review Letters, Vol. 82, Issue 25
Path integral Monte Carlo simulations of warm dense sodium
journal, December 2016
 Zhang, Shuai; Driver, Kevin P.; Soubiran, François
 High Energy Density Physics, Vol. 21
Equation of state and shock compression of warm dense sodium—A firstprinciples study
journal, February 2017
 Zhang, Shuai; Driver, Kevin P.; Soubiran, François
 The Journal of Chemical Physics, Vol. 146, Issue 7
Properties of ${\mathrm{B}}_{4}\mathrm{C}$ in the shocked state for pressures up to 1.5 TPa
journal, May 2017
 Shamp, Andrew; Zurek, Eva; Ogitsu, Tadashi
 Physical Review B, Vol. 95, Issue 18
Comparison of path integral Monte Carlo simulations of helium, carbon, nitrogen, oxygen, water, neon, and silicon plasmas
journal, June 2017
 Driver, K. P.; Soubiran, Francois; Zhang, Shuai
 High Energy Density Physics, Vol. 23
Firstprinciples equation of state and shock compression predictions of warm dense hydrocarbons
journal, July 2017
 Zhang, Shuai; Driver, Kevin P.; Soubiran, François
 Physical Review E, Vol. 96, Issue 1
Adaptive local basis set for Kohn–Sham density functional theory in a discontinuous Galerkin framework I: Total energy calculation
journal, February 2012
 Lin, Lin; Lu, Jianfeng; Ying, Lexing
 Journal of Computational Physics, Vol. 231, Issue 4
Adaptive local basis set for Kohn–Sham density functional theory in a discontinuous Galerkin framework II: Force, vibration, and molecular dynamics calculations
journal, April 2017
 Zhang, Gaigong; Lin, Lin; Hu, Wei
 Journal of Computational Physics, Vol. 335
Efficient iterative schemes for ab initio totalenergy calculations using a planewave basis set
journal, October 1996
 Kresse, G.; Furthmüller, J.
 Physical Review B, Vol. 54, Issue 16, p. 1116911186
Works referencing / citing this record:
Electronic annealing Fermi operator expansion for DFT calculations on metallic systems
journal, February 2018
 Aarons, Jolyon; Skylaris, ChrisKriton
 The Journal of Chemical Physics, Vol. 148, Issue 7
Equation of state for a chemically dissociative, polyatomic system: Carbon dioxide
journal, December 2019
 Wu, Christine J.; Young, David A.; Sterne, Philip A.
 The Journal of Chemical Physics, Vol. 151, Issue 22
Symmetryadapted realspace density functional theory for cylindrical geometries: Application to large groupIV nanotubes
journal, September 2019
 Ghosh, Swarnava; Banerjee, Amartya S.; Suryanarayana, Phanish
 Physical Review B, Vol. 100, Issue 12
Equation of state of boron nitride combining computation, modeling, and experiment
journal, April 2019
 Zhang, Shuai; Lazicki, Amy; Militzer, Burkhard
 Physical Review B, Vol. 99, Issue 16
Figures / Tables found in this record: