Hybrid Host/Network Topologies for Massive Storage Clusters

The high demand for large scale storage capacity calls for the availability of massive storage solutions with high performance interconnects. Although cluster file systems are rapidly improving and have the potential to allow extremely large numbers of commodity storage nodes to be pooled into a single large file-system, the number of ports on individual switches has not been increasing as quickly -- the largest switches available today support fewer than 2,000 Gigabit Ethernet ports. Our goal, therefore, is to develop a new interconnect topology that can connect hundreds of thousands of nodes and achieve performance comparable to a single switch of equivalent size. At the same time, such a new topology should be readily buildable using inexpensive components. Our proposed architecture exploits the multiple Ethernet ports that are now standard on servers and combines host-based routing and forwarding with network-based switching to allow massively large storage clusters to be built. S...

• Type: Conference
• Year: 2007
• Where: MSS
• Authors: Asha Andrade, Ungzu Mun, Dong Hwan Chung, Alexander E. Mohr
• Keywords: Commodity Storage Nodes, Ethernet Ports, Internet Technology, MSS 2007, Storage Nodes