Message Passing for Linux Clusters with Gigabit Ethernet Mesh Connections

Multiple copper-based commodity Gigabit Ethernet (GigE) interconnects (adapters) on a single host can lead to Linux clusters with mesh/torus connections without using expensive switches and high speed network interconnects (NICs). However traditional message passing systems based on TCP for GigE will not perform well for this type of clusters because of the overhead of TCP for multiple GigE links. In this paper, we present two os-bypass message passing systems that are based on a modified M-VIA (an implementation of VIA specification) for two production GigE mesh clusters: one is constructed as a 4x8x8 (256 nodes) torus and has been in production use for a year; the other is constructed as a 6x8x8 (384 nodes) torus and was deployed recently. One of the message passing systems targets to a specific application domain and is called QMP and the other is an implemen

• Type: Conference
• Year: 2005
• Where: IPPS
• Authors: Jie Chen, William A. Watson III, Robert Edwards, Weizhen Mao
• Keywords: Distributed And Parallel Computing, GigE, GigE Mesh Clusters, IPPS 2005, Message Passing Systems