Hierarchical Scheduling of DAG Structured Computations on Manycore Processors with Dynamic Thread Grouping

Many computational solutions can be expressed as directed acyclic graphs (DAGs) with weighted nodes. In parallel computing, scheduling such DAGs onto manycore processors remains a fundamental challenge, since synchronization across dozens of threads and preserving precedence constraints can dramatically degrade the performance. In order to improve scheduling performance on manycore processors, we propose a hierarchical scheduling method with dynamic thread grouping, which schedules DAG structured computations at three different levels. At the top level, a supermanager separates threads into groups, each consisting of a manager thread and several worker threads. The supermanager dynamically merges and partitions the groups to adapt the scheduler to the input task dependency graphs. Through group merging and partitioning, the proposed scheduler can dynamically adjust to become a centralized scheduler, a distributed scheduler or somewhere in between, depending on the input graph. At the g...

• Type: Journal
• Year: 2010
• Where: JSSPP
• Authors: Yinglong Xia, Viktor K. Prasanna, James Li
• Keywords: Distributed And Parallel Computing, Distributed Schedulers, Input Task Dependency, JSSPP 2010, Manycore Processor