skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Massively parallel first-principles simulation of electron dynamics in materials

Journal Article · · Journal of Parallel and Distributed Computing

Here we present a highly scalable, parallel implementation of first-principles electron dynamics coupled with molecular dynamics (MD). By using optimized kernels, network topology aware communication, and by fully distributing all terms in the time-dependent Kohn–Sham equation, we demonstrate unprecedented time to solution for disordered aluminum systems of 2000 atoms (22,000 electrons) and 5400 atoms (59,400 electrons), with wall clock time as low as 7.5 s per MD time step. Despite a significant amount of non-local communication required in every iteration, we achieved excellent strong scaling and sustained performance on the Sequoia Blue Gene/Q supercomputer at LLNL. We obtained up to 59% of the theoretical sustained peak performance on 16,384 nodes and performance of 8.75 Petaflop/s (43% of theoretical peak) on the full 98,304 node machine (1,572,864 cores). Lastly, scalable explicit electron dynamics allows for the study of phenomena beyond the reach of standard first-principles MD, in particular, materials subject to strong or rapid perturbations, such as pulsed electromagnetic radiation, particle irradiation, or strong electric currents.

Research Organization:
Lawrence Livermore National Lab. (LLNL), Livermore, CA (United States)
Sponsoring Organization:
USDOE National Nuclear Security Administration (NNSA)
Grant/Contract Number:
AC52-07NA27344
OSTI ID:
1349002
Alternate ID(s):
OSTI ID: 1415865
Report Number(s):
LLNL-JRNL-670641
Journal Information:
Journal of Parallel and Distributed Computing, Vol. 106, Issue C; ISSN 0743-7315
Publisher:
ElsevierCopyright Statement
Country of Publication:
United States
Language:
English
Citation Metrics:
Cited by: 33 works
Citation information provided by
Web of Science

References (34)

Modified Ehrenfest Formalism for Efficient Large-Scale ab initio Molecular Dynamics journal March 2009
Application of compressed sensing to the simulation of atomic systems journal August 2012
Unified Approach for Molecular Dynamics and Density-Functional Theory journal November 1985
octopus: a tool for the application of time-dependent density functional theory journal September 2006
Excited states dynamics in time-dependent density functional theory journal February 2004
Controlling the Dynamics of Many-Electron Systems from First Principles: A Combination of Optimal Control and Time-Dependent Density-Functional Theory journal October 2012
Electrical conductivity for warm, dense aluminum plasmas and liquids journal August 2002
Current-driven atomic waterwheels journal February 2009
A survey of the parallel performance and accuracy of Poisson solvers for electronic structure calculations journal November 2013
Ab initio angle- and energy-resolved photoelectron spectroscopy with time-dependent density-functional theory journal June 2012
Gordon Bell finalists I---Large-scale electronic structure calculations of high-Z metals on the BlueGene/L platform conference January 2006
Inhomogeneous Electron Gas journal November 1964
Self-Consistent Equations Including Exchange and Correlation Effects journal November 1965
Scalable High-Performance Algorithm for the Simulation of Exciton Dynamics. Application to the Light-Harvesting Complex II in the Presence of Resonant Vibrational Modes journal August 2014
Efficient iterative schemes for ab initio total-energy calculations using a plane-wave basis set journal October 1996
Time-dependent quantum transport: A practical scheme using density functional theory journal July 2005
Ab initio quantum dynamics using coupled-cluster journal May 2012
Time-Dependent Density Functional Theory journal June 2004
Nonlocal Hermitian norm-conserving Vanderbilt pseudopotential journal March 1993
Massively-parallel electron dynamics calculations in real-time and real-space: Toward applications to nanostructures of more than ten-nanometers in size journal May 2014
First-principles electron dynamics simulation for optical breakdown of dielectrics under an intense laser field journal April 2008
Time-dependent density functional theory with ultrasoft pseudopotentials: Real-time electron propagation across a molecular junction journal January 2006
Conductivity of warm dense matter including electron-electron collisions journal April 2015
Density-Functional Theory for Time-Dependent Systems journal March 1984
Quantum Dynamics Simulation of Electrons in Materials on High-Performance Computers journal September 2014
Plane-wave pseudopotential implementation of explicit integrators for time-dependent Kohn-Sham equations in large-scale simulations journal December 2012
Accurate atomistic first-principles calculations of electronic stopping journal January 2015
Real-time time-dependent density functional theory approach for frequency-dependent nonlinear optical response in photonic molecules journal October 2007
Molecular dynamics in electronically excited states using time-dependent density functional theory journal March 2005
Resonance Raman spectra of ortho -nitrophenol calculated by real-time time-dependent density functional theory journal January 2013
Efficient pseudopotentials for plane-wave calculations journal January 1991
Integrating the Car–Parrinello equations. I. Basic integration techniques journal July 1994
Towards a gauge invariant method for molecular chiroptical properties in TDDFT journal January 2009
Time-dependent local-density approximation in real time journal August 1996

Cited By (9)

Ab initio simulations of liquid electrolytes for energy conversion and storage journal October 2018
Heavy ion ranges from first-principles electron dynamics journal April 2019
Propagation of maximally localized Wannier functions in real-time TDDFT journal May 2019
Exponential integrators in time-dependent density-functional calculations journal December 2017
Core Electrons in the Electronic Stopping of Heavy Ions journal September 2018
Electronic stopping and proton dynamics in InP, GaP, and In0.5Ga0.5P from first principles journal October 2018
Exponential Integrators in Time-Dependent Density Functional Calculations text January 2017
Electronic stopping and proton dynamics in InP, GaP, and In$_{0.5}$Ga$_{0.5}$P from first principles text January 2018
Propagation of maximally localized Wannier functions in real-time TDDFT text January 2019