The Self-Tuning dynP Job-Scheduler

In modern resource management systems for supercomputers and HPC-clusters the job-scheduler plays a major role in improving the performance and usability of the system. The performance of the used scheduling policies (e.g. FCFS, SJF, LJF) depends on the characteristics of the queued jobs. Hence we developed the dynP scheduler family. The basic idea was to change between different scheduling policies during runtime. The basic dynP scheduler uses the average estimated runtime of all queued jobs together with two input parameters to decide when a policy change may be bene£cal. A disadvantage is that the performance of the basic dynP scheduler strongly depends on the right setting of the two input parameters. Therefore we present the self-tuning dynP scheduler, which is totally independent from any parameter values. The basic concept is that the self-tuning dynP scheduler computes the full (virtual) schedule for each of the three policies in every scheduling step. Each computed schedule ...

• Type: Conference
• Year: 2002
• Where: IPPS
• Authors: Achim Streit
• Keywords: Basic DynP Scheduler, Distributed And Parallel Computing, DynP Scheduler, IPPS 2002, Self-tuning DynP Scheduler