VNET/P: bridging the cloud and high performance computing through fast overlay networking

networking with a layer 2 abstraction provides a powerful model for virtualized wide-area distributed computing resources, including for high performance computing (HPC) on collections of virtual machines (VMs). With the emergence of cloud computing, it is now possible to allow VMs hosting tightly-coupled HPC applications to seamlessly migrate between distributed cloud resources and tightly-coupled supercomputing and cluster resources. However, to achieve the application performance that the tightly-coupled resources are capable of, it is important that the overlay network not introduce significant overhead relative to the native hardware. To support such a model, we describe the design, implementation, and evaluation of a virtual networking system that has negligible latency and bandwidth overheads in 1-10 Gbps networks. Our system, VNET/P, is embedded into our publicly available Palacios virtual machine monitor (VMM). VNET/P achieves native performance on 1 Gbps Ethernet networks an...

• Type: Journal
• Year: 2012
• Where: HPDC
• Authors: Lei Xia, Zheng Cui, John R. Lange, Yuan Tang, Peter A. Dinda, Patrick G. Bridges
• Keywords: Distributed And Parallel Computing, HPDC 2012, National Science Foundation, Virtual Machine Monitor Vmm, Virtual Networking