The Minos Computing Library: Efficient Parallel Programming for Extremely Heterogeneous Systems

Conference · Mon Mar 02 04:00:00 EST 2020

DOI:https://doi.org/10.1145/3366428.3380770· OSTI ID:1607685

Gioiosa, Roberto ^[1]; Mutlu, Burcu ^[1]; Lee, Seyong ^[2]; Vetter, Jeffrey S. ^[2]; Picierro, Giulio ^[3]; Cesati, Marco ^[4]

---

1. BATTELLE (PACIFIC NW LAB)
2. Oak Ridge National Laboratory
3. UNIVERSITY PROGRAMS
4. Università degli Studi di Roma -Tor Vergata

Hardware specialization has become the silver bullet to achieve efficient high performance, from Systems-on-Chip systems, where hardware specialization can be ``extreme'', to large-scale HPC systems. As the complexity of the systems increases, so does the complexity of programming such architectures in a portable way. This work introduces the Minos Computing Library (MCL), as system software, programming model, and programming model runtime that facilitate programming extremely heterogeneous systems. MCL supports the execution of several multi-threaded applications within the same compute node, performs asynchronous execution of application tasks, efficiently balances computation across hardware resources, and provides performance portability. We show that code developed on a personal desktop automatically scales up to fully utilize powerful workstations with 8 GPUs and down to power-efficient embedded systems. MCL provides up to 17.5x speedup over OpenCL on NVIDIA DGX-1 systems and up to 1.88x speedup on single-GPU systems. In multi-application workloads, MCL dynamically resource allocation provides up to 2.43x performance improvement over manual, static allocation of computing resources.

• Research Organization: Pacific Northwest National Laboratory (PNNL), Richland, WA (United States)
• Sponsoring Organization: USDOE
• DOE Contract Number: AC05-76RL01830
• OSTI ID: 1607685
• Report Number(s): PNNL-SA-150725
• Country of Publication: United States
• Language: English