skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: DFT-FE – A massively parallel adaptive finite-element code for large-scale density functional theory calculations

Journal Article · · Computer Physics Communications

We present an accurate, efficient and massively parallel finite-element code, DFT-FE, for large-scale ab-initio calculations (reaching ~100,000 electrons) using Kohn-Sham density functional theory (DFT). DFT-FE is based on a local real-space variational formulation of the Kohn-Sham DFT energy functional that is discretized using a higher-order adaptive spectral finite-element (FE) basis, and treats pseudopotential and all-electron calculations in the same framework, while accommodating non-periodic, semi-periodic and periodic boundary conditions. We discuss the main aspects of the code, which include, the various strategies of adaptive FE basis generation, and the different approaches employed in the numerical implementation of the solution of the discrete Kohn-Sham problem that are focused on significantly reducing the floating point operations, communication costs and latency. We demonstrate the accuracy of DFT-FE by comparing the energies, ionic forces and periodic cell stresses on a wide range of problems with popularly used DFT codes. Further, we demonstrate that DFT-FE significantly outperforms widely used plane-wave codes---both in CPU-times and wall-times, and on both non-periodic and periodic systems---at systems sizes beyond a few thousand electrons, with over 5-10 fold speedups in systems with more than 10,000 electrons. In conclusion, the benchmark studies also highlight the excellent parallel scalability of DFT-FE, with strong scaling demonstrated on up to 192,000 MPI tasks.

Research Organization:
Univ. of Michigan, Ann Arbor, MI (United States)
Sponsoring Organization:
USDOE Office of Science (SC), Basic Energy Sciences (BES); National Science Foundation (NSF); DURIP; German Research Foundation (DFG)
Grant/Contract Number:
SC0008637; SC0017380; ACI-1053575; AC02-05CH11231; W911NF1810242; DA 1664/2-1
OSTI ID:
1656758
Alternate ID(s):
OSTI ID: 1572128
Journal Information:
Computer Physics Communications, Vol. 246; ISSN 0010-4655
Publisher:
ElsevierCopyright Statement
Country of Publication:
United States
Language:
English
Citation Metrics:
Cited by: 57 works
Citation information provided by
Web of Science

References (95)

Self-Consistent Equations Including Exchange and Correlation Effects journal November 1965
Density Functional and Density Matrix Method Scaling Linearly with the Number of Atoms journal April 1996
Ab initio modeling of dislocation core properties in metals and semiconductors journal February 2017
Ab Initio Study of Screw Dislocations in Mo and Ta: A New Picture of Plasticity in bcc Transition Metals journal February 2000
The Chemistry of Deformation: How Solutes Soften Pure Metals journal December 2005
Prediction of Dislocation Cores in Aluminum from Density Functional Theory journal January 2008
Dislocation Core Energies and Core Fields from First Principles journal February 2009
Orbital-free density functional theory simulations of dislocations in magnesium journal November 2011
Possible origin of the discrepancy in Peierls stresses of fcc metals: First-principles simulations of dislocation mobility in aluminum journal August 2013
Electronic-structure study of an edge dislocation in Aluminum and the role of macroscopic deformations on its energetics journal March 2015
Orbital-free density functional theory study of the energetics of vacancy clustering and prismatic dislocation loop nucleation in aluminium journal July 2016
Electronic structure study of screw dislocation core energetics in Aluminum and core energetics informed forces in a dislocation aggregate journal July 2017
Composition Screening of Lithium- and Sodium-Rich Anti-Perovskites for Fast-Conducting Solid Electrolytes journal September 2018
Molecular Dynamics Modeling of the Structure and Na + -Ion Transport in Na 2 S + SiS 2 Glassy Electrolytes journal June 2018
QUANTUM ESPRESSO: a modular and open-source software project for quantum simulations of materials journal September 2009
First-principles computation of material properties: the ABINIT software project journal November 2002
Efficient iterative schemes for ab initio total-energy calculations using a plane-wave basis set journal October 1996
Self‐Consistent Molecular‐Orbital Methods. I. Use of Gaussian Expansions of Slater‐Type Atomic Orbitals journal September 1969
Polarization consistent basis sets. II. Estimating the Kohn–Sham basis set limit journal May 2002
Ab initio molecular simulations with numeric atom-centered orbitals journal November 2009
NWChem: A comprehensive and scalable open-source solution for large scale molecular simulations journal September 2010
Electronic-structure calculations based on the finite-element method journal August 1995
Adaptive finite-element method for electronic-structure calculations journal September 1996
Real-space local polynomial basis for solid-state electronic-structure calculations: A finite-element approach journal May 1999
Finite element methods in ab initio electronic structure calculations journal April 2005
Classical and enriched finite element formulations for Bloch-periodic boundary conditions journal February 2009
Non-periodic finite-element formulation of Kohn–Sham density functional theory journal February 2010
Finite element approximations of nonlinear eigenvalue problems in quantum physics journal May 2011
Higher-order adaptive finite-element methods for Kohn–Sham density functional theory journal November 2013
All-electron Kohn–Sham density functional theory on hierarchic finite element spaces journal October 2013
Adaptive Finite Element Approximations for Kohn--Sham Models journal January 2014
On the adaptive finite element analysis of the Kohn-Sham equations: methods, algorithms, and implementation: On the adaptive finite element analysis of the Kohn-Sham equations: methods, algorithms, and implementation
  • Davydov, Denis; Young, Toby D.; Steinmann, Paul
  • International Journal for Numerical Methods in Engineering, Vol. 106, Issue 11 https://doi.org/10.1002/nme.5140
journal November 2015
Large-scale all-electron density functional theory calculations using an enriched finite-element basis journal January 2017
Matrix-Free Locally Adaptive Finite Element Solution of Density-Functional Theory With Nonorthogonal Orbitals and Multigrid Preconditioning journal July 2018
PARSEC – the pseudopotential algorithm for real-space electronic structure calculations: recent advances and novel applications to nano-structures journal April 2006
RESCU: A real space electronic structure method journal February 2016
SPARC: Accurate and efficient finite-difference formulation and parallel implementation of Density Functional Theory: Isolated clusters journal March 2017
SPARC: Accurate and efficient finite-difference formulation and parallel implementation of Density Functional Theory: Extended systems journal July 2017
Real-space grids and the Octopus code as tools for the development of new simulation approaches for electronic systems journal January 2015
Daubechies wavelets as a basis set for density functional pseudopotential calculations journal July 2008
Introducing ONETEP : Linear-scaling density functional simulations on parallel computers journal February 2005
DGDFT: A massively parallel method for large scale density functional theory calculations journal September 2015
Spectrum-splitting approach for Fermi-operator expansion in all-electron Kohn-Sham DFT calculations journal January 2017
Linear scaling electronic structure methods journal July 1999
\mathcal{O}(N) methods in electronic structure calculations journal February 2012
Linear-scaling first-principles molecular dynamics with plane-waves accuracy journal March 2006
Linear-scaling three-dimensional fragment method for large-scale electronic structure calculations journal April 2008
Subquadratic-scaling subspace projection method for large-scale Kohn-Sham density functional theory calculations using spectral finite-element discretization journal September 2014
Electronic annealing Fermi operator expansion for DFT calculations on metallic systems journal February 2018
Linear scaling DFT calculations for large tungsten systems using an optimized local basis journal May 2018
Parallel self-consistent-field calculations via Chebyshev-filtered subspace acceleration journal December 2006
A spectrum slicing method for the Kohn–Sham problem journal March 2012
Self-consistent-field calculations using Chebyshev-filtered subspace iteration journal November 2006
Configurational forces in electronic structure calculations using Kohn-Sham density functional theory journal April 2018
Advanced capabilities for materials modelling with Quantum ESPRESSO journal October 2017
Beyond the local-density approximation in calculations of ground-state electronic properties journal August 1983
Accurate and simple analytic representation of the electron-gas correlation energy journal June 1992
Generalized Gradient Approximation Made Simple journal October 1996
Efficacious Form for Model Pseudopotentials journal May 1982
Efficient pseudopotentials for plane-wave calculations journal January 1991
Non-periodic finite-element formulation of orbital-free density functional theory journal April 2007
Special points for Brillouin-zone integrations journal June 1976
The deal.II library, Version 9.0 journal December 2018
Adaptive Finite Element Method for Solving the Exact Kohn−Sham Equation of Density Functional Theory journal March 2009
All-electron density functional theory and time-dependent density functional theory with high-order finite elements journal January 2009
Quasi-continuum orbital-free density-functional theory: A route to multi-million atom non-periodic DFT calculation journal April 2007
Multiscale simulations in simple metals: A density-functional-based methodology journal March 2005
From electrons to finite elements: A concurrent multiscale approach for metals journal January 2006
p4est : Scalable Algorithms for Parallel Adaptive Mesh Refinement on Forests of Octrees journal January 2011
Convergence and optimal complexity of adaptive finite element eigenvalue computations journal August 2008
An h-adaptive finite element solver for the calculations of the electronic structures journal May 2012
Error estimation and adaptive meshing in strongly nonlinear dynamic problems journal April 1999
Iterative Procedures for Nonlinear Integral Equations journal October 1965
A class of methods for solving nonlinear simultaneous equations journal January 1965
A generic interface for parallel cell-based finite element operator application journal June 2012
Very large scale wavefunction orthogonalization in Density Functional Theory electronic structure calculations journal June 2010
Iterative diagonalization of symmetric matrices in mixed precision and its application to electronic structure calculations journal April 2012
Two-Level Chebyshev Filter Based Complementary Subspace Method: Pushing the Envelope of Large-Scale Electronic Structure Calculations journal April 2018
Efficient iteration scheme for self-consistent pseudopotential calculations journal March 1981
A Comparative Study on Methods for Convergence Acceleration of Iterative Vector Sequences journal March 1996
A black-box self-consistent field convergence algorithm: One step closer journal January 2002
Elliptic Preconditioner for Accelerating the Self-Consistent Field Iteration in Kohn--Sham Density Functional Theory journal January 2013
Applicability of Kerker preconditioning scheme to the self-consistent density functional theory calculations of inhomogeneous systems journal March 2018
Algorithms and data structures for massively parallel generic adaptive finite element codes journal December 2011
An algorithm with guaranteed convergence for finding a zero of a function journal April 1971
On the limited memory BFGS method for large scale optimization journal August 1989
Structural Relaxation Made Simple journal October 2006
Optimization algorithm for the generation of ONCV pseudopotentials journal November 2015
Beyond Magic Numbers: Atomic Scale Equilibrium Nanoparticle Shapes for Any Size journal August 2017
SPARC: Accurate and efficient finite-difference formulation and parallel implementation of Density Functional Theory: Extended systems dataset January 2017
SPARC: Accurate and efficient finite-difference formulation and parallel implementation of Density Functional Theory: Isolated clusters dataset January 2017
exciting: a full-potential all-electron package implementing density-functional theory and many-body perturbation theory journal August 2014
Daubechies wavelets as a basis set for density functional pseudopotential calculations text January 2008
Dislocation Core Energies and Core Fields from First Principles text January 2009
Optimization Algorithm for the Generation of ONCV Pseudopotentials text January 2015

Cited By (1)

Large scale ab-initio simulations of dislocations journal April 2020