Finding a tradeoff between host interrupt load and MPI latency over Ethernet

—Achieving high-performance message passing on top of generic ETHERNET hardware suffers from the NIC interruptdriven model where coalescing is usually involved. We present an in-depth study of the impact of interrupt coalescing on the OPENMX performance. It shows that disabling coalescing may not be relevant for most metrics except small-message latency. Two new coalescing strategies are then presented so as to efficiently support both latency-friendly and coalescing-friendly workloads thanks to the NIC looking at OPEN-MX messages and streams before deciding when to raise interrupts. The implementation of these strategies in the firmware of MYRI-10G NICs shows that OPEN-MX is now able to achieve a low small-message latency, a high large-message throughput, and a satisfying message rate without having to manually tune the coalescing delay depending on the benchmark. Real application performance evaluation further shows that our modifications even improve the NAS Parallel Benchmark ...

• Type: Conference
• Year: 2009
• Where: CLUSTER
• Authors: Brice Goglin, Nathalie Furmento
• Keywords: CLUSTER 2009, Coalescing Delay, Interrupt Coalescing, Small-message Latency