Scalability Analysis and Evaluation of Divisible Load Scheduling

• Published in: 2014 43rd International Conference on Parallel Processing Workshops pp. 37 - 44
• Main Authors: Balasubramaniam, Mahadevan, Banicescu, Ioana, Ciorba, Florina M.
• Format: Conference Proceeding
• Language: English
• Published: IEEE 01.09.2014
• Subjects: Benchmark testing; Computational modeling; Divisible load theory; high performance computing systems; Load modeling; Mathematical model; Processor scheduling; Runtime; Scalability
• ISSN: 0190-3918; 2332-5690
• DOI: 10.1109/ICPPW.2014.18

In this work, we address the problem of the scalability of divisible load scheduling of data parallel workloads (also called arbitrarily divisible workloads) on high performance parallel and distributed computing systems. Divisible load theory offers a linear, deterministic, and tractable model for scheduling arbitrarily divisible workloads, often encountered in scientific applications. With the continuous increasing problem and the system sizes, it is imperative that application scheduling algorithms scale well to leverage the processing capabilities of the high performance computing systems. We conduct an analytical evaluation as well as a simulation-based study of the scalability of divisible load scheduling algorithms, called DLT algorithms, when applied for scheduling two NAS parallel benchmarks, namely, the embarrassingly parallel (EP) and the integer sort (IS) benchmarks onto a target system modeled as a 3-d torus topology. The EP benchmark is computationally intensive and the IS benchmark is communication intensive. Two questions related to the scalability study are addressed, namely, the fastest time to solve the problem and the condition for cost-optimality. A simulation-based study was conducted to support and verify the solutions obtained via the analytical model.