Sciweavers

EUROPAR
2006
Springer

Analysis of the Memory Registration Process in the Mellanox InfiniBand Software Stack

14 years 3 months ago
Analysis of the Memory Registration Process in the Mellanox InfiniBand Software Stack
Abstract. To leverage high speed interconnects like InfiniBand it is important to minimize the communication overhead. The most interfering overhead is the registration of communication memory. In this paper, we present our analysis of the memory registration process inside the Mellanox InfiniBand driver and possible ways out of this bottleneck. We evaluate and characterize the most time consuming parts in the execution path of the memory registration function using the Read Time Stamp Counter (RDTSC) instruction. We present measurements on AMD Opteron and Intel Xeon systems with different types of Host Channel Adapters for PCI-X and PCI-Express. Finally, we conclude with first results using Linux hugepage support to shorten the time of registering a memory region.
Frank Mietke, Robert Rex, Robert Baumgartl, Torste
Added 22 Aug 2010
Updated 22 Aug 2010
Type Conference
Year 2006
Where EUROPAR
Authors Frank Mietke, Robert Rex, Robert Baumgartl, Torsten Mehlan, Torsten Hoefler, Wolfgang Rehm
Comments (0)