Exploring Infiniband Hardware Virtualization in OpenNebula towards Efficient High-Performance Computing

Conference · Tue Nov 11 04:00:00 EST 2014

OSTI ID:1294527

Pais Pitta de Lacerda Ruivo, Tiago ^[1]; Bernabeu Altayo, Gerard ^[2]; Garzoglio, Gabriele ^[2]; Timm, Steven ^[2]; Kim, Hyun-Woo ^[2]; Noh, Seo-Young ^[3]; Raicu, Ioan ^[1]

---

1. IIT, Chicago
2. Fermilab
3. KISTI, Daejeon

has been widely accepted that software virtualization has a big negative impact on high-performance computing (HPC) application performance. This work explores the potential use of Infiniband hardware virtualization in an OpenNebula cloud towards the efficient support of MPI-based workloads. We have implemented, deployed, and tested an Infiniband network on the FermiCloud private Infrastructure-as-a-Service (IaaS) cloud. To avoid software virtualization towards minimizing the virtualization overhead, we employed a technique called Single Root Input/Output Virtualization (SRIOV). Our solution spanned modifications to the Linux’s Hypervisor as well as the OpenNebula manager. We evaluated the performance of the hardware virtualization on up to 56 virtual machines connected by up to 8 DDR Infiniband network links, with micro-benchmarks (latency and bandwidth) as well as w a MPI-intensive application (the HPL Linpack benchmark).

• Research Organization: Fermi National Accelerator Laboratory (FNAL), Batavia, IL (United States)
• Sponsoring Organization: USDOE Office of Science (SC), High Energy Physics (HEP) (SC-25)
• DOE Contract Number: AC02-07CH11359
• OSTI ID: 1294527
• Report Number(s): FERMILAB-CONF-14-470-CD; 1480143
• Country of Publication: United States
• Language: English