On Load-Balancing Algorithm for Distributed Data Stream Management Systems

In distributed data stream management system, data streams are processed by many computers cooperatively. When input data streams fluctuate tempestuously, overload of some nodes may influence the ability of data processing about system. To solve this practical problem, the properties of the system w...

Full description

Saved in:
Bibliographic Details
Published in2006 6th World Congress on Intelligent Control and Automation Vol. 1; pp. 4204 - 4208
Main Authors Xiaoxia Rong, Jindong Wang
Format Conference Proceeding
LanguageEnglish
Published IEEE 2006
Subjects
Data processing
data stream
data stream management system
Distributed computing
Educational institutions
Identity management systems
Information science
Internet
load balance
Load management
Mathematics
overlay network
Space technology
Technology management
Online AccessGet full text

Cover

More Information
Summary:In distributed data stream management system, data streams are processed by many computers cooperatively. When input data streams fluctuate tempestuously, overload of some nodes may influence the ability of data processing about system. To solve this practical problem, the properties of the system were analysed. A multi-layer overlay based load balancing algorithm was proposed in this paper, which can balance load of tightly-coupled distributed data stream management system in Internet. This algorithm collects node-load and send target-load using virtual tree-structure, it also maps address by virtual circle-structure to match the load distribution information early so the time of load-move was decreased. This multi-layer structure can response quickly the effect caused by the departure or crumple of node, which makes the system refresh easily. At last we demonstrate properties of the algorithm using simulation and experiments
ISBN:9781424403325
1424403324
DOI:10.1109/WCICA.2006.1713167