Spinning relations: high-speed networks for distributed join processing

By leveraging modern networking hardware (RDMA-enabled network cards), we can shift priorities in distributed database processing significantly. Complex and sophisticated mechanisms to avoid network traffic can be replaced by a scheme that takes advantage of the bandwidth and low latency offered by such interconnects. We illustrate this phenomenon with cyclo-join, an efficient join algorithm based on continuously pumping data through a ring-structured network. Our approach is capable of exploiting the resources of all CPUs and distributed main-memory available in the network for processing queries of arbitrary shape and datasets of arbitrary size.

• Type: Conference
• Year: 2009
• Where: DAMON
• Authors: Philip Werner Frey, Romulo Goncalves, Martin L. Kersten, Jens Teubner
• Keywords: DAMON 2009, Informatics, Modern Networking Hardware, Network Traffic, RDMA-enabled Network Cards