Enabling Parallel Performance and Portability of Solid Mechanics Simulations Across CPU and GPU Architectures

Morgan, Nathaniel; Yenusah, Caleb; Diaz, Adrian; Dunning, Daniel; Moore, Jacob; Heilman, Erin; Lieberman, Evan; Walton, Steven; Brown, Sarah; Holladay, Daniel; Marki, Russell; Robey, Robert; Knezevic, Marko

doi:10.3390/info15110716

Title: Enabling Parallel Performance and Portability of Solid Mechanics Simulations Across CPU and GPU Architectures

Journal Article · 07 November 2024 · Information

DOI: https://doi.org/10.3390/info15110716 · OSTI ID:2476578

;

; Lieberman, Evan; Walton, Steven; Brown, Sarah;

; Marki, Russell;

; Knezevic, Marko

Efficiently simulating solid mechanics is vital across various engineering applications. As constitutive models grow more complex and simulations scale up in size, harnessing the capabilities of modern computer architectures has become essential for achieving timely results. This paper presents advancements in running parallel simulations of solid mechanics on multi-core CPUs and GPUs using a single-code implementation. This portability is made possible by the C++ matrix and array (MATAR) library, which interfaces with the C++ Kokkos library, enabling the selection of fine-grained parallelism backends (e.g., CUDA, HIP, OpenMP, pthreads, etc.) at compile time. MATAR simplifies the transition from Fortran to C++ and Kokkos, making it easier to modernize legacy solid mechanics codes. We applied this approach to modernize a suite of constitutive models and to demonstrate substantial performance improvements across different computer architectures. This paper includes comparative performance studies using multi-core CPUs along with AMD and NVIDIA GPUs. Results are presented using a hypoelastic–plastic model, a crystal plasticity model, and the viscoplastic self-consistent generalized material model (VPSC-GMM). The results underscore the potential of using the MATAR library and modern computer architectures to accelerate solid mechanics simulations.

View Journal Article

Cite

Export

Save

Sponsoring Organization:: USDOE National Nuclear Security Administration (NNSA)

Grant/Contract Number:: 89233218CNA000001

OSTI ID:: 2476578

Journal Information:: Information, Journal Name: Information Journal Issue: 11 Vol. 15; ISSN INFOGG; ISSN 2078-2489

Publisher:: MDPI AGCopyright Statement

Country of Publication:: Switzerland

Language:: English

References (51)

A 3D finite element ALE method using an approximate Riemann solution: 3D FINITE ELEMENT ALE METHOD Chiravalle, V. P.; Morgan, N. R. International Journal for Numerical Methods in Fluids, Vol. 83, Issue 8 https://doi.org/10.1002/fld.4284	journal	August 2016
A call to arms for task parallelism in multi-scale materials modeling Barton, Nathan R.; Bernier, Joel V.; Knap, Jaroslaw International Journal for Numerical Methods in Engineering, Vol. 86, Issue 6 https://doi.org/10.1002/nme.3071	journal	February 2011
Crystal plasticity with Jacobian-Free Newton–Krylov Chockalingam, K.; Tonks, M. R.; Hales, J. D. Computational Mechanics, Vol. 51, Issue 5 https://doi.org/10.1007/s00466-012-0741-7	journal	July 2012
Computer implementations of iterative and non-iterative crystal plasticity solvers on high performance graphics hardware Savage, Daniel J.; Knezevic, Marko Computational Mechanics, Vol. 56, Issue 4 https://doi.org/10.1007/s00466-015-1194-6	journal	August 2015
Parallel 3D topology optimization with multiple constraints and objectives Diaz, Adrian; Morgan, Nathaniel; Bernardin, John Optimization and Engineering, Vol. 25, Issue 3 https://doi.org/10.1007/s11081-023-09852-6	journal	September 2023
Crystallographic texture evolution in bulk deformation processing of FCC metals Kalidindi, S. R.; Bronkhorst, C. A.; Anand, L. Journal of the Mechanics and Physics of Solids, Vol. 40, Issue 3 https://doi.org/10.1016/0022-5096(92)80003-9	journal	January 1992
A self-consistent anisotropic approach for the simulation of plastic deformation and texture development of polycrystals: Application to zirconium alloys Lebensohn, R. A.; Tomé, C. N. Acta Metallurgica et Materialia, Vol. 41, Issue 9 https://doi.org/10.1016/0956-7151(93)90130-K	journal	September 1993
Evolution of crystal orientation distribution coefficients during plastic deformation Li, D. S.; Garmestani, H.; Schoenfeld, Scott Scripta Materialia, Vol. 49, Issue 9 https://doi.org/10.1016/S1359-6462(03)00443-3	journal	November 2003
Spectral calibration of crystal plasticity models Kalidindi, Surya R.; Duvvuru, Hari K.; Knezevic, Marko Acta Materialia, Vol. 54, Issue 7 https://doi.org/10.1016/j.actamat.2005.12.018	journal	April 2006
Linear analysis of texture–property relationships using process-based representations of Rodrigues space Sundararaghavan, V.; Zabaras, N. Acta Materialia, Vol. 55, Issue 5 https://doi.org/10.1016/j.actamat.2006.10.019	journal	March 2007
Crystal plasticity simulations using discrete Fourier transforms Knezevic, Marko; Al-Harbi, Hamad F.; Kalidindi, Surya R. Acta Materialia, Vol. 57, Issue 6 https://doi.org/10.1016/j.actamat.2008.12.017	journal	April 2009
Grain size and orientation distributions: Application to yielding of α-titanium Fromm, Bradley S.; Adams, Brent L.; Ahmadi, Sadegh Acta Materialia, Vol. 57, Issue 8 https://doi.org/10.1016/j.actamat.2008.12.037	journal	May 2009
Representation of the orientation distribution function and computation of first-order elastic properties closures using discrete Fourier transforms Kalidindi, Surya R.; Knezevic, Marko; Niezgoda, Stephen Acta Materialia, Vol. 57, Issue 13 https://doi.org/10.1016/j.actamat.2009.04.055	journal	August 2009
Microstructural effects on damage evolution in shocked copper polycrystals Lieberman, Evan J.; Lebensohn, Ricardo A.; Menasche, David B. Acta Materialia, Vol. 116 https://doi.org/10.1016/j.actamat.2016.06.054	journal	September 2016
Predicting intragranular misorientation distributions in polycrystalline metals using the viscoplastic self-consistent formulation Zecevic, Miroslav; Pantleon, Wolfgang; Lebensohn, Ricardo A. Acta Materialia, Vol. 140 https://doi.org/10.1016/j.actamat.2017.08.056	journal	November 2017
Compact reconstruction of orientation distributions using generalized spherical harmonics to advance large-scale crystal plasticity modeling: Verification using cubic, hexagonal, and orthorhombic polycrystals Eghtesad, Adnan; Barrett, Timothy J.; Knezevic, Marko Acta Materialia, Vol. 155 https://doi.org/10.1016/j.actamat.2018.06.017	journal	August 2018
Graphics processing unit accelerated phase field dislocation dynamics: Application to bi-metallic interfaces Eghtesad, Adnan; Germaschewski, Kai; Beyerlein, Irene J. Advances in Engineering Software, Vol. 115 https://doi.org/10.1016/j.advengsoft.2017.09.010	journal	January 2018
Key computational modeling issues in Integrated Computational Materials Engineering Panchal, Jitesh H.; Kalidindi, Surya R.; McDowell, David L. Computer-Aided Design, Vol. 45, Issue 1 https://doi.org/10.1016/j.cad.2012.06.006	journal	January 2013
A fourth-order Lagrangian discontinuous Galerkin method using a hierarchical orthogonal basis on curvilinear grids Liu, Xiaodong; Morgan, Nathaniel R.; Lieberman, Evan J. Journal of Computational and Applied Mathematics, Vol. 404 https://doi.org/10.1016/j.cam.2021.113890	journal	April 2022
Three dimensional predictions of grain scale plasticity and grain boundaries using crystal plasticity finite element models Knezevic, Marko; Drach, Borys; Ardeljan, Milan Computer Methods in Applied Mechanics and Engineering, Vol. 277 https://doi.org/10.1016/j.cma.2014.05.003	journal	August 2014
A higher-order Lagrangian discontinuous Galerkin hydrodynamic method for solid dynamics Lieberman, Evan J.; Liu, Xiaodong; Morgan, Nathaniel R. Computer Methods in Applied Mechanics and Engineering, Vol. 353 https://doi.org/10.1016/j.cma.2019.05.006	journal	August 2019
Deep drawing simulations using the finite element method embedding a multi-level crystal plasticity constitutive law: Experimental verification and sensitivity analysis Barrett, Timothy J.; Knezevic, Marko Computer Methods in Applied Mechanics and Engineering, Vol. 354 https://doi.org/10.1016/j.cma.2019.05.035	journal	September 2019
Efficient two-scale FE-FFT-based mechanical process simulation of elasto-viscoplastic polycrystals at finite strains Gierden, Christian; Kochmann, Julian; Waimann, Johanna Computer Methods in Applied Mechanics and Engineering, Vol. 374 https://doi.org/10.1016/j.cma.2020.113566	journal	February 2021
Application of microstructure sensitive design to structural components produced from hexagonal polycrystalline metals Fast, Tony; Knezevic, Marko; Kalidindi, Surya R. Computational Materials Science, Vol. 43, Issue 2 https://doi.org/10.1016/j.commatsci.2007.12.002	journal	August 2008
A high-performance computational framework for fast crystal plasticity simulations Knezevic, Marko; Savage, Daniel J. Computational Materials Science, Vol. 83 https://doi.org/10.1016/j.commatsci.2013.11.012	journal	February 2014
A cell-centered Lagrangian Godunov-like method for solid dynamics Burton, D. E.; Carney, T. C.; Morgan, N. R. Computers & Fluids, Vol. 83 https://doi.org/10.1016/j.compfluid.2012.09.008	journal	August 2013
A multi-GPU implementation of a full-field crystal plasticity solver for efficient modeling of high-resolution microstructures Eghtesad, Adnan; Germaschewski, Kai; Lebensohn, Ricardo A. Computer Physics Communications, Vol. 254 https://doi.org/10.1016/j.cpc.2020.107231	journal	September 2020
A parallel and performance portable implementation of a full-field crystal plasticity model Yenusah, Caleb O.; Morgan, Nathaniel R.; Lebensohn, Ricardo A. Computer Physics Communications, Vol. 300 https://doi.org/10.1016/j.cpc.2024.109190	journal	July 2024
Embedded polycrystal plasticity and adaptive sampling Barton, Nathan R.; Knap, Jaroslaw; Arsenlis, Athanasios International Journal of Plasticity, Vol. 24, Issue 2 https://doi.org/10.1016/j.ijplas.2007.03.004	journal	February 2008
Delineation of first-order closures for plastic properties requiring explicit consideration of strain hardening and crystallographic texture evolution Knezevic, Marko; Kalidindi, Surya R.; Mishra, Raja K. International Journal of Plasticity, Vol. 24, Issue 2 https://doi.org/10.1016/j.ijplas.2007.05.002	journal	February 2008
Building texture evolution networks for deformation processing of polycrystalline fcc metals using spectral approaches: Applications to process design for targeted performance Shaffer, Joshua B.; Knezevic, Marko; Kalidindi, Surya R. International Journal of Plasticity, Vol. 26, Issue 8 https://doi.org/10.1016/j.ijplas.2010.03.010	journal	August 2010
Multiscale modeling of plasticity based on embedding the viscoplastic self-consistent formulation in implicit finite elements Segurado, Javier; Lebensohn, Ricardo A.; LLorca, Javier International Journal of Plasticity, Vol. 28, Issue 1 https://doi.org/10.1016/j.ijplas.2011.07.002	journal	January 2012
An elasto-viscoplastic formulation based on fast Fourier transforms for the prediction of micromechanical fields in polycrystalline materials Lebensohn, Ricardo A.; Kanjarla, Anand K.; Eisenlohr, Philip International Journal of Plasticity, Vol. 32-33 https://doi.org/10.1016/j.ijplas.2011.12.005	journal	May 2012
Coupling elasto-plastic self-consistent crystal plasticity and implicit finite elements: Applications to compression, cyclic tension-compression, and bending to large strains Zecevic, Milovan; Beyerlein, Irene J.; Knezevic, Marko International Journal of Plasticity, Vol. 93 https://doi.org/10.1016/j.ijplas.2016.07.016	journal	June 2017
Predicting extreme anisotropy and shape variations in impact testing of tantalum single crystals Feng, Zhangxi; Zecevic, Miroslav; Knezevic, Marko International Journal of Solids and Structures, Vol. 241 https://doi.org/10.1016/j.ijsolstr.2022.111466	journal	April 2022
A high-order Lagrangian discontinuous Galerkin hydrodynamic method for quadratic cells using a subcell mesh stabilization scheme Liu, Xiaodong; Morgan, Nathaniel R.; Burton, Donald E. Journal of Computational Physics, Vol. 386 https://doi.org/10.1016/j.jcp.2019.02.008	journal	June 2019
A dislocation density based crystal plasticity finite element model: Application to a two-phase polycrystalline HCP/BCC composites Ardeljan, Milan; Beyerlein, Irene J.; Knezevic, Marko Journal of the Mechanics and Physics of Solids, Vol. 66 https://doi.org/10.1016/j.jmps.2014.01.006	journal	May 2014
High-performance full-field crystal plasticity with dislocation-based hardening and slip system back-stress laws: Application to modeling deformation of dual-phase steels Eghtesad, Adnan; Knezevic, Marko Journal of the Mechanics and Physics of Solids, Vol. 134 https://doi.org/10.1016/j.jmps.2019.103750	journal	January 2020
Kokkos: Enabling manycore performance portability through polymorphic memory access patterns Carter Edwards, H.; Trott, Christian R.; Sunderland, Daniel Journal of Parallel and Distributed Computing, Vol. 74, Issue 12 https://doi.org/10.1016/j.jpdc.2014.07.003	journal	December 2014
MATAR: A performance portability and productivity implementation of data-oriented design with Kokkos Dunning, Daniel J.; Morgan, Nathaniel R.; Moore, Jacob L. Journal of Parallel and Distributed Computing, Vol. 157 https://doi.org/10.1016/j.jpdc.2021.03.016	journal	November 2021
An implicit formulation of the elasto-plastic self-consistent polycrystal plasticity model and its implementation in implicit finite elements Zecevic, Milovan; Knezevic, Marko Mechanics of Materials, Vol. 136 https://doi.org/10.1016/j.mechmat.2019.103065	journal	September 2019
New large-strain FFT-based formulation and its application to model strain localization in nano-metallic laminates and other strongly anisotropic crystalline materials Zecevic, Miroslav; Lebensohn, Ricardo A.; Capolungo, Laurent Mechanics of Materials, Vol. 166 https://doi.org/10.1016/j.mechmat.2021.104208	journal	March 2022
Elasto-viscoplastic tensile behavior of as-forged Ti-1023 alloy: Experiments and micromechanical modeling Lhadi, Safaa; Purushottam raj purohit, Ravi raj purohit; Richeton, Thiebaud Materials Science and Engineering: A, Vol. 787 https://doi.org/10.1016/j.msea.2020.139491	journal	June 2020
ELEMENTS: A high-order finite element library in C++ Moore, Jacob L.; Morgan, Nathaniel R.; Horstemeyer, Mark F. SoftwareX, Vol. 10 https://doi.org/10.1016/j.softx.2019.100257	journal	July 2019
On the Origins of Lagrangian Hydrodynamic Methods Morgan, Nathaniel R.; Archer, Billy J. Nuclear Technology, Vol. 207, Issue sup1 https://doi.org/10.1080/00295450.2021.1913034	journal	November 2021
The GPU Computing Era Nickolls, John; Dally, William J. IEEE Micro, Vol. 30, Issue 2 https://doi.org/10.1109/MM.2010.41	journal	March 2010
Performance Portability across Diverse Computer Architectures Deakin, Tom; McIntosh-Smith, Simon; Price, James 2019 IEEE/ACM International Workshop on Performance, Portability and Productivity in HPC (P3HPC) https://doi.org/10.1109/P3HPC49587.2019.00006	conference	November 2019
Multidimensional Staggered Grid Residual Distribution Scheme for Lagrangian Hydrodynamics Abgrall, Rémi; Lipnikov, Konstantin; Morgan, Nathaniel SIAM Journal on Scientific Computing, Vol. 42, Issue 1 https://doi.org/10.1137/18M1223939	journal	January 2020
A Fortran to C converter Feldman, S. I. ACM SIGPLAN Fortran Forum, Vol. 9, Issue 2 https://doi.org/10.1145/101363.101366	journal	October 1990
Automatic Fortran to C++ conversion with FABLE Grosse-Kunstleve, Ralf W.; Terwilliger, Thomas C.; Sauter, Nicholas K. Source Code for Biology and Medicine, Vol. 7, Issue 1 https://doi.org/10.1186/1751-0473-7-5	journal	May 2012
On a Simplified Approach to Achieve Parallel Performance and Portability Across CPU and GPU Architectures Morgan, Nathaniel; Yenusah, Caleb; Diaz, Adrian Information, Vol. 15, Issue 11 https://doi.org/10.3390/info15110673	journal	October 2024

Similar Records

On a Simplified Approach to Achieve Parallel Performance and Portability Across CPU and GPU Architectures

Journal Article · 2024 · Information · OSTI ID:2475228

Morgan, Nathaniel; Yenusah, Caleb; Diaz, Adrian; +12 more

A parallel and performance portable implementation of a full-field crystal plasticity model

Journal Article · 2024 · Computer Physics Communications · OSTI ID:2588977

Yenusah, Caleb Onuh; Morgan, Nathaniel Ray; Lebensohn, Ricardo A.; +2 more

Performance Results on CPU/GPU Exascale Architectures for OMEGA: The Ocean Model for E3SM Global Applications

Technical Report · 2024 · OSTI ID:2448297

Ringel, Kieran Kelly; Petersen, Mark Roger

Title: Enabling Parallel Performance and Portability of Solid Mechanics Simulations Across CPU and GPU Architectures

Citation Formats

References (51)

Similar Records

Related Subjects