Exploring Infiniband Hardware Virtualization in OpenNebula towards Efficient High-Performance Computing
- IIT, Chicago
- Fermilab
- KISTI, Daejeon
has been widely accepted that software virtualization has a big negative impact on high-performance computing (HPC) application performance. This work explores the potential use of Infiniband hardware virtualization in an OpenNebula cloud towards the efficient support of MPI-based workloads. We have implemented, deployed, and tested an Infiniband network on the FermiCloud private Infrastructure-as-a-Service (IaaS) cloud. To avoid software virtualization towards minimizing the virtualization overhead, we employed a technique called Single Root Input/Output Virtualization (SRIOV). Our solution spanned modifications to the Linux’s Hypervisor as well as the OpenNebula manager. We evaluated the performance of the hardware virtualization on up to 56 virtual machines connected by up to 8 DDR Infiniband network links, with micro-benchmarks (latency and bandwidth) as well as w a MPI-intensive application (the HPL Linpack benchmark).
- Research Organization:
- Fermi National Accelerator Lab. (FNAL), Batavia, IL (United States)
- Sponsoring Organization:
- USDOE Office of Science (SC), High Energy Physics (HEP)
- DOE Contract Number:
- AC02-07CH11359
- OSTI ID:
- 1294527
- Report Number(s):
- FERMILAB-CONF-14-470-CD; 1480143
- Country of Publication:
- United States
- Language:
- English
Similar Records
Review of Enabling Technologies to Facilitate Secure Compute Customization
An Efficient Hardware-Software Approach to Network Fault Tolerance with InfiniBand