Multithreaded parallelization of the energy and analytic gradient in the fragment molecular orbital method
Abstract
The fragment molecular orbital method in GAMESS is parallelized in a multithreaded OpenMP implementation combined with the MPI version of the two-level generalized distributed data interface. The energy and analytic gradient in gas phase and the polarizable continuum model of solvation are parallelized in this hybrid three-level scheme, achieving a large memory footprint reduction and a high parallel efficiency on Intel Xeon Phi processors. The parallel efficiency is demonstrated on the Stampede2 and Theta supercomputers using up to 2048 nodes (262 144 threads).
- Authors:
-
- Lomonosov Moscow State Univ. (Russian Federation)
- Argonne National Lab. (ANL), Argonne, IL (United States)
- National Inst. of Advanced Industrial Science and Technology (AIST), Tsukuba (Japan)
- Publication Date:
- Research Org.:
- Argonne National Laboratory (ANL), Argonne, IL (United States)
- Sponsoring Org.:
- USDOE National Nuclear Security Administration (NNSA); USDOE Office of Science (SC)
- OSTI Identifier:
- 1529983
- Grant/Contract Number:
- AC02-06CH11357
- Resource Type:
- Accepted Manuscript
- Journal Name:
- International Journal of Quantum Chemistry
- Additional Journal Information:
- Journal Volume: 119; Journal Issue: 12; Journal ID: ISSN 0020-7608
- Publisher:
- Wiley
- Country of Publication:
- United States
- Language:
- English
- Subject:
- 37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CHEMISTRY; DDI; FMO; GAMESS; MPI; OpenMP; parallelization
Citation Formats
Mironov, Vladimir, Alexeev, Yuri, and Fedorov, Dmitri G. Multithreaded parallelization of the energy and analytic gradient in the fragment molecular orbital method. United States: N. p., 2019.
Web. doi:10.1002/qua.25937.
Mironov, Vladimir, Alexeev, Yuri, & Fedorov, Dmitri G. Multithreaded parallelization of the energy and analytic gradient in the fragment molecular orbital method. United States. https://doi.org/10.1002/qua.25937
Mironov, Vladimir, Alexeev, Yuri, and Fedorov, Dmitri G. Fri .
"Multithreaded parallelization of the energy and analytic gradient in the fragment molecular orbital method". United States. https://doi.org/10.1002/qua.25937. https://www.osti.gov/servlets/purl/1529983.
@article{osti_1529983,
title = {Multithreaded parallelization of the energy and analytic gradient in the fragment molecular orbital method},
author = {Mironov, Vladimir and Alexeev, Yuri and Fedorov, Dmitri G.},
abstractNote = {The fragment molecular orbital method in GAMESS is parallelized in a multithreaded OpenMP implementation combined with the MPI version of the two-level generalized distributed data interface. The energy and analytic gradient in gas phase and the polarizable continuum model of solvation are parallelized in this hybrid three-level scheme, achieving a large memory footprint reduction and a high parallel efficiency on Intel Xeon Phi processors. The parallel efficiency is demonstrated on the Stampede2 and Theta supercomputers using up to 2048 nodes (262 144 threads).},
doi = {10.1002/qua.25937},
journal = {International Journal of Quantum Chemistry},
number = 12,
volume = 119,
place = {United States},
year = {Fri Apr 26 00:00:00 EDT 2019},
month = {Fri Apr 26 00:00:00 EDT 2019}
}
Free Publicly Available Full Text
Publisher's Version of Record
Other availability
Cited by: 10 works
Citation information provided by
Web of Science
Web of Science
Save to My Library
You must Sign In or Create an Account in order to save documents to your library.
Works referenced in this record:
Large-Scale Computations in Chemistry: A Bird’s Eye View of a Vibrant Field
journal, April 2015
- Akimov, Alexey V.; Prezhdo, Oleg V.
- Chemical Reviews, Vol. 115, Issue 12
Linear scaling electronic structure methods
journal, July 1999
- Goedecker, Stefan
- Reviews of Modern Physics, Vol. 71, Issue 4
Linear Scaling Density Functional Calculations with Gaussian Orbitals
journal, June 1999
- Scuseria, Gustavo E.
- The Journal of Physical Chemistry A, Vol. 103, Issue 25
Linear-Scaling Techniques in Computational Chemistry and Physics: Methods and Applications
book, January 2011
- Zalesny, Robert; Papadopoulos, Manthos G.; Mezey, Paul G.
- Challenges and Advances in Computational Chemistry and Physics
Density matrix search using direct inversion in the iterative subspace as a linear scaling alternative to diagonalization in electronic structure calculations
journal, October 2003
- Li, Xiaosong; Millam, John M.; Scuseria, Gustavo E.
- The Journal of Chemical Physics, Vol. 119, Issue 15
Efficient Calculation of Electronic Structure Using O(N) Density Functional Theory
journal, August 2017
- Nakata, Ayako; Futamura, Yasunori; Sakurai, Tetsuya
- Journal of Chemical Theory and Computation, Vol. 13, Issue 9
Hybrid MPI-OpenMP Parallelism in the ONETEP Linear-Scaling Electronic Structure Code: Application to the Delamination of Cellulose Nanofibrils
journal, October 2014
- Wilkinson, Karl A.; Hine, Nicholas D. M.; Skylaris, Chris-Kriton
- Journal of Chemical Theory and Computation, Vol. 10, Issue 11
Fragmentation Methods: A Route to Accurate Calculations on Large Systems
journal, August 2011
- Gordon, Mark S.; Fedorov, Dmitri G.; Pruitt, Spencer R.
- Chemical Reviews, Vol. 112, Issue 1
Investigation of the interaction between molecules at medium distances
journal, April 1975
- Otto, P.; Ladik, J.
- Chemical Physics, Vol. 8, Issue 1-2
Toward a Molecular Orbital Derived Empirical Potential for Liquid Simulations
journal, January 1997
- Gao, Jiali
- The Journal of Physical Chemistry B, Vol. 101, Issue 4
Divide and Conquer Hartree−Fock Calculations on Proteins
journal, January 2010
- He, Xiao; Merz, Kenneth M.
- Journal of Chemical Theory and Computation, Vol. 6, Issue 2
Water 26-mers Drawn from Bulk Simulations: Benchmark Binding Energies for Unprecedentedly Large Water Clusters and Assessment of the Electrostatically Embedded Three-Body and Pairwise Additive Approximations
journal, January 2014
- Friedrich, Joachim; Yu, Haoyu; Leverentz, Hannah R.
- The Journal of Physical Chemistry Letters, Vol. 5, Issue 4
Calculation of protein–ligand binding affinities based on a fragment quantum mechanical method
journal, January 2015
- Liu, Jinfeng; Wang, Xianwei; Zhang, John Z. H.
- RSC Advances, Vol. 5, Issue 129
Coupled-Cluster Interaction Energies for 200-Atom Host-Guest Systems
journal, September 2014
- Andrejić, Milica; Ryde, Ulf; Mata, Ricardo A.
- ChemPhysChem, Vol. 15, Issue 15
Extension of the Effective Fragment Potential Method to Macromolecules
journal, June 2016
- Gurunathan, Pradeep Kumar; Acharya, Atanu; Ghosh, Debashree
- The Journal of Physical Chemistry B, Vol. 120, Issue 27
Ab initio molecular dynamics with intramolecular noncovalent interactions for unsolvated polypeptides
journal, January 2016
- Zhang, Lei; Li, Wei; Fang, Tao
- Theoretical Chemistry Accounts, Vol. 135, Issue 2
Systematic fragmentation of large molecules by annihilation
journal, January 2012
- Collins, Michael A.
- Physical Chemistry Chemical Physics, Vol. 14, Issue 21
Vibrational infrared and Raman spectra of polypeptides: Fragments-in-fragments within molecular tailoring approach
journal, March 2016
- Sahu, Nityananda; Gadre, Shridhar R.
- The Journal of Chemical Physics, Vol. 144, Issue 11
N -body:Many-body QM:QM vibrational frequencies: Application to small hydrogen-bonded clusters
journal, November 2013
- Howard, J. Coleman; Tschumper, Gregory S.
- The Journal of Chemical Physics, Vol. 139, Issue 18
Accurate prediction of the structure and vibrational spectra of ionic liquid clusters with the generalized energy-based fragmentation approach: critical role of ion-pair-based fragmentation
journal, January 2018
- Li, Yunzhi; Yuan, Dandan; Wang, Qingchun
- Physical Chemistry Chemical Physics, Vol. 20, Issue 19
Theoretical Study of Protein–Ligand Interactions Using the Molecules-in-Molecules Fragmentation-Based Method
journal, August 2018
- Thapa, Bishnu; Beckett, Daniel; Erickson, Jon
- Journal of Chemical Theory and Computation, Vol. 14, Issue 10
Automated error control in divide-and-conquer self-consistent field calculations: Automated Error Control
journal, February 2018
- Kobayashi, Masato; Fujimori, Toshikazu; Taketsugu, Tetsuya
- Journal of Computational Chemistry, Vol. 39, Issue 15
Fragment molecular orbital method: an approximate computational method for large molecules
journal, November 1999
- Kitaura, Kazuo; Ikeo, Eiji; Asada, Toshio
- Chemical Physics Letters, Vol. 313, Issue 3-4
Extending the Power of Quantum Chemistry to Large Systems with the Fragment Molecular Orbital Method
journal, August 2007
- Fedorov, Dmitri G.; Kitaura, Kazuo
- The Journal of Physical Chemistry A, Vol. 111, Issue 30
Exploring chemistry with the fragment molecular orbital method
journal, January 2012
- Fedorov, Dmitri G.; Nagata, Takeshi; Kitaura, Kazuo
- Physical Chemistry Chemical Physics, Vol. 14, Issue 21
Electron-correlated fragment-molecular-orbital calculations for biomolecular and nano systems
journal, January 2014
- Tanaka, Shigenori; Mochizuki, Yuji; Komeiji, Yuto
- Phys. Chem. Chem. Phys., Vol. 16, Issue 22
The fragment molecular orbital method: theoretical development, implementation in GAMESS, and applications: Fragment molecular orbital method in GAMESS
journal, June 2017
- Fedorov, Dmitri G.
- Wiley Interdisciplinary Reviews: Computational Molecular Science, Vol. 7, Issue 6
The Use of Many-Body Expansions and Geometry Optimizations in Fragment-Based Methods
journal, July 2014
- Fedorov, Dmitri G.; Asada, Naoya; Nakanishi, Isao
- Accounts of Chemical Research, Vol. 47, Issue 9
Importance of Three-Body Interactions in Molecular Dynamics Simulations of Water Demonstrated with the Fragment Molecular Orbital Method
journal, March 2016
- Pruitt, Spencer R.; Nakata, Hiroya; Nagata, Takeshi
- Journal of Chemical Theory and Computation, Vol. 12, Issue 4
Energy Decomposition Analysis in Solution Based on the Fragment Molecular Orbital Method
journal, December 2011
- Fedorov, Dmitri G.; Kitaura, Kazuo
- The Journal of Physical Chemistry A, Vol. 116, Issue 1
Subsystem Analysis for the Fragment Molecular Orbital Method and Its Application to Protein–Ligand Binding in Solution
journal, March 2016
- Fedorov, Dmitri G.; Kitaura, Kazuo
- The Journal of Physical Chemistry A, Vol. 120, Issue 14
Pair Interaction Energy Decomposition Analysis for Density Functional Theory and Density-Functional Tight-Binding with an Evaluation of Energy Fluctuations in Molecular Dynamics
journal, February 2018
- Fedorov, Dmitri G.; Kitaura, Kazuo
- The Journal of Physical Chemistry A, Vol. 122, Issue 6
Towards good correlation between fragment molecular orbital interaction energies and experimental IC50 for ligand binding: A case study of p38 MAP kinase
journal, January 2018
- Sheng, Yinglei; Watanabe, Hirofumi; Maruyama, Keiya
- Computational and Structural Biotechnology Journal, Vol. 16
Simulations of Chemical Reactions with the Frozen Domain Formulation of the Fragment Molecular Orbital Method
journal, June 2015
- Nakata, Hiroya; Fedorov, Dmitri G.; Nagata, Takeshi
- Journal of Chemical Theory and Computation, Vol. 11, Issue 7
The fragment molecular orbital method combined with density-functional tight-binding and the polarizable continuum model
journal, January 2016
- Nishimoto, Yoshio; Fedorov, Dmitri G.
- Physical Chemistry Chemical Physics, Vol. 18, Issue 32
Development of the Fragment Molecular Orbital Method for Calculating Nonlocal Excitations in Large Molecular Systems
journal, March 2018
- Fujita, Takatoshi; Mochizuki, Yuji
- The Journal of Physical Chemistry A, Vol. 122, Issue 15
Heuristic static load-balancing algorithm applied to the fragment molecular orbital method
conference, November 2012
- Alexeev, Yuri; Mahajan, Ashutosh; Leyffer, Sven
- 2012 SC - International Conference for High Performance Computing, Networking, Storage and Analysis, 2012 International Conference for High Performance Computing, Networking, Storage and Analysis
General atomic and molecular electronic structure system
journal, November 1993
- Schmidt, Michael W.; Baldridge, Kim K.; Boatz, Jerry A.
- Journal of Computational Chemistry, Vol. 14, Issue 11, p. 1347-1363
Advances in electronic structure theory
book, January 2005
- Gordon, Mark S.; Schmidt, Michael W.
- Theory and Applications of Computational Chemistry
A new hierarchical parallelization scheme: Generalized distributed data interface (GDDI), and an application to the fragment molecular orbital method (FMO)
journal, January 2004
- Fedorov, Dmitri G.; Olson, Ryan M.; Kitaura, Kazuo
- Journal of Computational Chemistry, Vol. 25, Issue 6
The importance of three-body terms in the fragment molecular orbital method
journal, April 2004
- Fedorov, Dmitri G.; Kitaura, Kazuo
- The Journal of Chemical Physics, Vol. 120, Issue 15
Theoretical study of the prion protein based on the fragment molecular orbital method
journal, December 2009
- Ishikawa, Takeshi; Ishikura, Takakazu; Kuwata, Kazuo
- Journal of Computational Chemistry, Vol. 30, Issue 16
Development of the four-body corrected fragment molecular orbital (FMO4) method
journal, January 2012
- Nakano, Tatsuya; Mochizuki, Yuji; Yamashita, Katsumi
- Chemical Physics Letters, Vol. 523
Large-Scale MP2 Calculations on the Blue Gene Architecture Using the Fragment Molecular Orbital Method
journal, December 2011
- Fletcher, Graham D.; Fedorov, Dmitri G.; Pruitt, Spencer R.
- Journal of Chemical Theory and Computation, Vol. 8, Issue 1
The parallel implementation of a full configuration interaction program
journal, July 2003
- Gan, Zhengting; Alexeev, Yuri; Gordon, Mark S.
- The Journal of Chemical Physics, Vol. 119, Issue 1
A parallel distributed data CPHF algorithm for analytic Hessians
journal, January 2007
- Alexeev, Yuri; Schmidt, Michael W.; Windus, Theresa L.
- Journal of Computational Chemistry, Vol. 28, Issue 10
An efficient MPI/OpenMP parallelization of the Hartree–Fock–Roothaan method for the first generation of Intel® Xeon Phi™ processor architecture
journal, February 2017
- Mironov, Vladimir; Moskovsky, Alexander; D’Mello, Michael
- The International Journal of High Performance Computing Applications, Vol. 33, Issue 1
MPI/OpenMP Hybrid Parallel Algorithm for Hartree−Fock Calculations
journal, March 2010
- Ishimura, Kazuya; Kuramoto, Kei; Ikuta, Yasuhiro
- Journal of Chemical Theory and Computation, Vol. 6, Issue 4
Fully analytic energy gradient in the fragment molecular orbital method
journal, March 2011
- Brorsen, Kurt; Fedorov, Dmitri G.
- The Journal of Chemical Physics, Vol. 134, Issue 12
The three-body fragment molecular orbital method for accurate calculations of large systems
journal, December 2006
- Fedorov, Dmitri G.; Kitaura, Kazuo
- Chemical Physics Letters, Vol. 433, Issue 1-3
Fragment molecular orbital method: use of approximate electrostatic potential
journal, January 2002
- Nakano, Tatsuya; Kaminuma, Tsuguchika; Sato, Toshiyuki
- Chemical Physics Letters, Vol. 351, Issue 5-6
On the accuracy of the 3-body fragment molecular orbital method (FMO) applied to density functional theory
journal, May 2004
- Fedorov, Dmitri G.; Kitaura, Kazuo
- Chemical Physics Letters, Vol. 389, Issue 1-3
Second order Møller-Plesset perturbation theory based upon the fragment molecular orbital method
journal, January 2004
- Fedorov, Dmitri G.; Kitaura, Kazuo
- The Journal of Chemical Physics, Vol. 121, Issue 6
Open-Shell Formulation of the Fragment Molecular Orbital Method
journal, December 2009
- Pruitt, Spencer R.; Fedorov, Dmitri G.; Kitaura, Kazuo
- Journal of Chemical Theory and Computation, Vol. 6, Issue 1
Unrestricted Hartree-Fock based on the fragment molecular orbital method: Energy and its analytic gradient
journal, July 2012
- Nakata, Hiroya; Fedorov, Dmitri G.; Nagata, Takeshi
- The Journal of Chemical Physics, Vol. 137, Issue 4
Pair interaction energy decomposition analysis
journal, January 2006
- Fedorov, Dmitri G.; Kitaura, Kazuo
- Journal of Computational Chemistry, Vol. 28, Issue 1
Power Measurements of Hartree-Fock Algorithms Using Different Storage Devices
conference, May 2017
- Mironov, Vladimir; Moskovsky, Alexander; Alexeev, Yuri
- 2017 IEEE International Parallel and Distributed Processing Symposium: Workshops (IPDPSW), 2017 IEEE International Parallel and Distributed Processing Symposium Workshops (IPDPSW)
PaSTRI: Error-Bounded Lossy Compression for Two-Electron Integrals in Quantum Chemistry
conference, September 2018
- Gok, Ali Murat; Di, Sheng; Alexeev, Yuri
- 2018 IEEE International Conference on Cluster Computing (CLUSTER)
Reducing the scaling of the fragment molecular orbital method using the multipole method
journal, August 2012
- Choi, Cheol Ho; Fedorov, Dmitri G.
- Chemical Physics Letters, Vol. 543
The polarizable continuum model (PCM) interfaced with the fragment molecular orbital method (FMO)
journal, January 2006
- Fedorov, Dmitri G.; Kitaura, Kazuo; Li, Hui
- Journal of Computational Chemistry, Vol. 27, Issue 8
Quantum Mechanical Continuum Solvation Models
journal, August 2005
- Tomasi, Jacopo; Mennucci, Benedetta; Cammi, Roberto
- Chemical Reviews, Vol. 105, Issue 8
Analytic gradient for second order Møller-Plesset perturbation theory with the polarizable continuum model based on the fragment molecular orbital method
journal, May 2012
- Nagata, Takeshi; Fedorov, Dmitri G.; Li, Hui
- The Journal of Chemical Physics, Vol. 136, Issue 20
Continuum solvation of large molecules described by QM/MM: a semi-iterative implementation of the PCM/EFP interface
journal, March 2003
- Li, Hui; Pomelli, Christian S.; Jensen, Jan H.
- Theoretical Chemistry Accounts: Theory, Computation, and Modeling (Theoretica Chimica Acta), Vol. 109, Issue 2
Analysis of solute-solvent interactions using the solvation model density combined with the fragment molecular orbital method
journal, June 2018
- Fedorov, Dmitri G.
- Chemical Physics Letters, Vol. 702
GAMESS As a Free Quantum-Mechanical Platform for Drug Research
journal, September 2012
- Alexeev, Yuri; P. Mazanetz, Michael; Ichihara, Osamu
- Current Topics in Medicinal Chemistry, Vol. 12, Issue 18
The Fragment Molecular Orbital Method Reveals New Insight into the Chemical Nature of GPCR–Ligand Interactions
journal, December 2015
- Heifetz, Alexander; Chudyk, Ewa I.; Gleave, Laura
- Journal of Chemical Information and Modeling, Vol. 56, Issue 1
Rapid and accurate assessment of GPCR-ligand interactions Using the fragment molecular orbital-based density-functional tight-binding method
journal, July 2017
- Morao, Inaki; Fedorov, Dmitri G.; Robinson, Roger
- Journal of Computational Chemistry, Vol. 38, Issue 23
Geometry Optimization of the Active Site of a Large System with the Fragment Molecular Orbital Method
journal, January 2011
- Fedorov, Dmitri G.; Alexeev, Yuri; Kitaura, Kazuo
- The Journal of Physical Chemistry Letters, Vol. 2, Issue 4
Density-Functional Tight-Binding Combined with the Fragment Molecular Orbital Method
journal, October 2014
- Nishimoto, Yoshio; Fedorov, Dmitri G.; Irle, Stephan
- Journal of Chemical Theory and Computation, Vol. 10, Issue 11
Effect of the damping function in dispersion corrected density functional theory
journal, March 2011
- Grimme, Stefan; Ehrlich, Stephan; Goerigk, Lars
- Journal of Computational Chemistry, Vol. 32, Issue 7
Empirical corrections and pair interaction energies in the fragment molecular orbital method
journal, August 2018
- Fedorov, Dmitri G.; Kromann, Jimmy C.; Jensen, Jan H.
- Chemical Physics Letters, Vol. 706
The Fragment Molecular Orbital Method for Geometry Optimizations of Polypeptides and Proteins
journal, April 2007
- Fedorov, Dmitri G.; Ishida, Toyokazu; Uebayasi, Masami
- The Journal of Physical Chemistry A, Vol. 111, Issue 14
Fragment molecular orbital method: application to molecular dynamics simulation, ‘ab initio FMO-MD’
journal, April 2003
- Komeiji, Yuto; Nakano, Tatsuya; Fukuzawa, Kaori
- Chemical Physics Letters, Vol. 372, Issue 3-4
Fragment Molecular Orbital method-based Molecular Dynamics (FMO-MD) as a simulator for chemical reactions in explicit solvation
journal, January 2009
- Komeiji, Yuto; Ishikawa, Takeshi; Mochizuki, Yuji
- Journal of Computational Chemistry, Vol. 30, Issue 1
Ab initio Path Integral Molecular Dynamics Based on Fragment Molecular Orbital Method
journal, October 2009
- Fujita, Takatoshi; Watanabe, Hirofumi; Tanaka, Shigenori
- Journal of the Physical Society of Japan, Vol. 78, Issue 10
Quantum Mechanical Continuum Solvation Models
journal, October 2005
- Tomasi, Jacopo; Menucci, Benedetta; Cammi, Roberto
- ChemInform, Vol. 36, Issue 42
Investigation of the interaction between molecules at medium distances
journal, January 1977
- Otto, P.; Ladik, J.
- Chemical Physics, Vol. 19, Issue 2
GAMESS As a Free Quantum-Mechanical Platform for Drug Research
journal, January 2013
- Alexeev, Yuri; Mazanetz, Michael P.; Ichihara, Osamu
- Current Topics in Medicinal Chemistry, Vol. 12, Issue 18
Efficient calculation of electronic structure using O(N) density functional theory
preprint, January 2017
- Nakata, Ayako; Futamura, Yasunori; Sakurai, Tetsuya
- arXiv
Empirical corrections and pair interaction energies in the fragment molecular orbital method
text, January 2018
- Fedorov, Dmitri G.; Kromann, Jimmy C.; Jensen, Jan H.
- arXiv