Experiences with Porting the FLASH Code to Ookami, an HPE Apollo 80 A64FX Platform

Harrison, Robert J.; Calder, Alan C.; Curtis, Tony; Siegmann, Eva; Michalowicz, Benjamin; Feldman, Catherine

doi:10.1145/3503470.3503478

Experiences with Porting the FLASH Code to Ookami, an HPE Apollo 80 A64FX Platform

Conference · 13 January 2022 · International Conference on High Performance Computing in Asia-Pacific Region Workshops

DOI:https://doi.org/10.1145/3503470.3503478· OSTI ID:1907875

Harrison, Robert J. ^[1]; Calder, Alan C. ^[1]; Curtis, Tony ^[1]; Siegmann, Eva ^[1]; Michalowicz, Benjamin ^[2]; Feldman, Catherine ^[1]

Stony Brook Univ., NY (United States)
The Ohio State Univ., Columbus, OH (United States)

We present initial experiences with running the community simulation code FLASH, developed at the University of Chicago for multi-scale multi-physics applications, on Ookami, a technology testbed featuring the A64FX processor developed by Fujitsu. Our effort focused largely on running FLASH “right out of the box” to see which combinations of compilers and software implementations (e.g. MPI) allowed the code to run with minimal modification. FLASH was one application in a larger effort to deploy Ookami; it served as a test for different versions of newly installed software, and as a cornerstone for the FAQ page of the Ookami website. Here, we report on our results with different compilers and other software, along with our initial scaling results and attempts to utilize the A64FX’s SVE instructions and NUMA architecture. We found that FLASH readily ran with different compilers and MPI implementations, and showed the expected good scaling with no turning. However, more work must be done to fully take advantage of the A64FX’s architectural features and produce a significant speedup for FLASH on Ookami.

Research Organization:: Stony Brook Univ., NY (United States)

Sponsoring Organization:: USDOE

DOE Contract Number:: FG02-87ER40317

OSTI ID:: 1907875

Journal Information:: International Conference on High Performance Computing in Asia-Pacific Region Workshops, Conference: HPCAsia 2022 Workshop: International Conference on High Performance Computing in Asia-Pacific Region Workshops, Held Virtually (Japan), 11-14 Jan 2022

Country of Publication:: United States

Language:: English

References (11)

Evolution of FLASH, a multi-physics scientific simulation code for high-performance computing Dubey, Anshu; Antypas, Katie; Calder, Alan C. The International Journal of High Performance Computing Applications, Vol. 28, Issue 2 https://doi.org/10.1177/1094342013505656	journal	October 2013
FLASH: An Adaptive Mesh Hydrodynamics Code for Modeling Astrophysical Thermonuclear Flashes Fryxell, B.; Olson, K.; Ricker, P. The Astrophysical Journal Supplement Series, Vol. 131, Issue 1 https://doi.org/10.1086/317361	journal	November 2000
TYPE Iax SUPERNOVAE: A NEW CLASS OF STELLAR EXPLOSION Foley, Ryan J.; Challis, P. J.; Chornock, R. The Astrophysical Journal, Vol. 767, Issue 1 https://doi.org/10.1088/0004-637X/767/1/57	journal	March 2013
PARAMESH: A parallel adaptive mesh refinement community toolkit MacNeice, Peter; Olson, Kevin M.; Mobarry, Clark Computer Physics Communications, Vol. 126, Issue 3 https://doi.org/10.1016/S0010-4655(99)00501-9	journal	April 2000
Deflagrations in hybrid CONe white dwarfs: a route to explain the faint Type Iax supernova 2008ha Kromer, M.; Ohlmann, S. T.; Pakmor, R. Monthly Notices of the Royal Astronomical Society, Vol. 450, Issue 3 https://doi.org/10.1093/mnras/stv886	journal	May 2015
The conductive propagation of nuclear flames. I - Degenerate C + O and O + NE + MG white dwarfs Timmes, F. X.; Woosley, S. E. The Astrophysical Journal, Vol. 396 https://doi.org/10.1086/171746	journal	September 1992
Power-Law Wrinkling Turbulence-Flame Interaction Model for Astrophysical Flames Jackson, Aaron P.; Townsley, Dean M.; Calder, Alan C. The Astrophysical Journal, Vol. 784, Issue 2 https://doi.org/10.1088/0004-637X/784/2/174	journal	March 2014
Flame capturing with an advection–reaction–diffusion model Vladimirova, Natalia; Weirs, V. Gregory; Ryzhik, Lenya Combustion Theory and Modelling, Vol. 10, Issue 5 https://doi.org/10.1080/13647830500464146	journal	October 2006
Invited Talk 1 Dubey, Anshu 2019 IEEE International Parallel and Distributed Processing Symposium Workshops (IPDPSW) https://doi.org/10.1109/IPDPSW.2019.00152	conference	May 2019
Propagation of Turbulent Flames in Supernovae Khokhlov, Alexei M. The Astrophysical Journal, Vol. 449 https://doi.org/10.1086/176091	journal	August 1995
Terascale turbulence computation using the FLASH3 application framework on the IBM Blue Gene/L system Fisher, R. T.; Kadanoff, L. P.; Lamb, D. Q. IBM Journal of Research and Development, Vol. 52, Issue 1.2 https://doi.org/10.1147/rd.521.0127	journal	January 2008

Similar Records

On Using Linux Kernel Huge Pages with FLASH, an Astrophysical Simulation Code

Journal Article · 2022 · Proceedings - IEEE International Conference on Cluster Computing · OSTI ID:1907872

Calder, Alan C.; Feldman, Catherine; Siegmann, Eva; +4 more

Ookami: Deployment and Initial Experiences

Conference · 2021 · Practice and Experience in Advanced Research Computing · OSTI ID:1907882

Burford, Andrew; Calder, Alan C.; Carlson, David; +15 more

Educating HPC Users in the use of advanced computing technology

Conference · 2021 · 2021 IEEE/ACM Ninth Workshop on Education for High Performance Computing (EduHPC) · OSTI ID:1907878

Siegmann, Eva; Calder, Alan; Feldman, Catherine; +1 more

Related Subjects

97 MATHEMATICS AND COMPUTING
79 ASTRONOMY AND ASTROPHYSICS
high-performance computing
A64FX
porting software
astrophysics

Experiences with Porting the FLASH Code to Ookami, an HPE Apollo 80 A64FX Platform

Citation Formats

References (11)

Similar Records

Related Subjects