Intra-Clustering: Accelerating On-chip Communication for Data Parallel Architectures

Abstract—Modern computation workloads contain abundant Data Level Parallelism(DLP), which requires specialized data parallel architectures, such as Graphics Processing Units(GPUs). With parallel programming models, such as CUDA and OpenCL, GPUs are easily to be programmed for non-graphics applications, and therefore become a costeffective approach for data parallel architectures. The large quantity of available parallelism places a heavy stress on the memory system as the limited number of pins confines the number of memory controllers on the chip. This creates a potential bottleneck for performance scalability of the GPUs. To accelerate communication with the memory system, we propose the Intra-Clustering on-chip network for data parallel architectures, which is built upon a traditional two-dimensional electrical mesh network with memory controllers connected through a nanophotonic ring and compute cores grouped into different clusters. Our evaluations with CUDA benchmarks show tha...

• Type: Journal
• Year: 2015
• Where: SBACPAD
• Authors: Wen Yuan, Rahul Boyapati, Lei Wang, Hyunjun Jang, Yuho Jin, Ki Hwan Yum, Eun Jung Kim 0001
• Keywords: Hardware, SBACPAD 2015