skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Demonstrating UPC++/Kokkos Interoperability in a Heat Conduction Simulation (Extended Abstract)

Conference ·
DOI:· OSTI ID:1820128

We describe the replacement of MPI with UPC++ in an existing Kokkos code that simulates heat conduction within a rectangular 3D object, as well as an analysis of the new code’s performance on CUDA accelerators. The key challenges were packing the halos in Kokkos data structures in a way that allowed for UPC++ remote memory access, and streamlining synchronization costs. Additional UPC++ abstractions used included global pointers, distributed objects, remote procedure calls, and futures. We also make use of the device allocator concept to facilitate data management in memory with unique properties, such as GPUs. Our results demonstrate that despite the algorithm’s good semantic match to message passing abstractions, straightforward modifications to use UPC++ communication deliver vastly improved performance and scalability in the common case. We find the one-sided UPC++ version written in a natural way exhibits good performance, whereas the message-passing version written in a straightforward way exhibits performance anomalies. We argue this represents a productivity benefit for one-sided communication models.

Research Organization:
Lawrence Berkeley National Lab. (LBNL), Berkeley, CA (United States)
Sponsoring Organization:
USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR)
DOE Contract Number:
Resource Relation:
Conference: PAW-ATM2021: Parallel Applications Workshop, Alternatives to MPI+X, 19 Nov 2021
Country of Publication:
United States

Similar Records

The Kokkos Ecosystem [Brief]
Technical Report · 2020 · OSTI ID:1820128

Kokkos R&D: Remote Memory Spaces WBS STPR 04 Milestone 7
Technical Report · 2018 · OSTI ID:1820128

UPC++: A PGAS extension for C++
Conference · 2014 · OSTI ID:1820128

Related Subjects