On construction of a well-balanced allocation strategy for heterogeneous multi-cluster computing environments

With the rapid increment of the heterogeneity of hardware devices, cluster computing has to encounter the problem of handling heterogeneous resources for exploiting the utilization of system resources. This paper introduces a new job allocation strategy based on multi-clusters in diskless environmen...

Full description

Saved in:
Bibliographic Details
Published inThe Journal of supercomputing Vol. 56; no. 3; pp. 270 - 299
Main Authors Yang, Chao-Tung, Lai, Kuan-Chou, Tung, Hao-Yu
Format Journal Article
LanguageEnglish
Published Boston Springer US 01.06.2011
Subjects
Algorithms
Allocations
Compilers
Computation
Computer Science
Construction
Devices
Heterogeneity
Interpreters
Performance evaluation
Processor Architectures
Programming Languages
Strategy
Heterogeneous
Multi-cluster
Resource monitoring
Job scheduling
Online AccessGet full text
ISSN0920-8542
1573-0484
DOI10.1007/s11227-009-0369-3

Cover

More Information
Summary:With the rapid increment of the heterogeneity of hardware devices, cluster computing has to encounter the problem of handling heterogeneous resources for exploiting the utilization of system resources. This paper introduces a new job allocation strategy based on multi-clusters in diskless environments. By adopting Ganglia as the resource monitor and Condor as the queue system, a heterogeneous multi-cluster system is also constructed with and without storage devices for evaluating the system performance. The proposed algorithm is called the Well-Balanced Allocation Strategy (WBAS) in which the scheduler dispatches MPI-based jobs to appropriate resources across multi-clusters. The strategy focuses on dispatching jobs to nodes with similar performance, thus equalizing execution times among all the required nodes. The WBAS is implemented on the constructed heterogeneous multi-cluster system to evaluate the performance of the scheduling strategy. The experimental results show that the proposed strategy performs well and could efficiently improve the system performance.
Bibliography:ObjectType-Article-2
SourceType-Scholarly Journals-1
ObjectType-Feature-1
content type line 23
ISSN:0920-8542
1573-0484
DOI:10.1007/s11227-009-0369-3