Progress towards accelerating HOMME on hybrid multi- core systems
- ORNL
- Cray, Inc.
- NOAA, Boulder, CO
- Sandia National Laboratories (SNL)
The suitability of a spectral element based dynamical core (HOMME) within the Community Atmospheric Model (CAM) for GPU-based architectures is examined and initial performance results are reported. This work was done within a project to enable CAM to run at high resolution on next generation, multi-petaflop systems. The dynamical core is the present focus because it dominates the performance profile of our target problem. HOMME enjoys good scalability due to its underlying cubed-sphere mesh with full two-dimensional decomposition and the localization of all computational work within each element. The thread blocking and code changes that allow HOMME to effectively use GPUs are described along with a rewritten vertical remapping scheme which improves performance on both CPUs and GPUs. Validation of results in the full HOMME model is also described. Remaining issues affecting performance include optimizing the boundary exchanges for the case of multiple spectral elements being computed on the GPU and using multiple CUDA streams to overlap data transfers with computations.
- Research Organization:
- Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States). National Center for Computational Sciences (NCCS)
- Sponsoring Organization:
- USDOE Office of Science (SC)
- DOE Contract Number:
- DE-AC05-00OR22725
- OSTI ID:
- 1050267
- Journal Information:
- International Journal of High Performance Computing Applications, Vol. 0, Issue 0
- Country of Publication:
- United States
- Language:
- English
Similar Records
Developing And Scaling an OpenFOAM Model to Study Turbulent Flow in a HFIR Coolant Channel
A Petascale Non-Hydrostatic Atmospheric Dynamical Core in the HOMME Framework