Domus – An Architecture for Cluster-Oriented Distributed Hash Tables

• Published in: Lecture notes in computer science pp. 296 - 303
• Main Authors: Rufino, José, Pina, António, Alves, Albano, Exposto, José
• Format: Book Chapter Conference Proceeding
• Language: English
• Published: Berlin, Heidelberg Springer Berlin Heidelberg 2006; Springer
• Series: Lecture Notes in Computer Science
• Subjects: Address Space; Applied sciences; Base Service; Client Application; Cluster Node; Computer science; control theory; systems; Computer systems and distributed systems. User interface; Exact sciences and technology; Software; Storage Service; Parallel algorithm; Storage management; Distributed algorithm; Hashing; Routing; Distributed system; Resource management; Distributed computing; Data warehouse
• ISBN: 3540341412; 9783540341413
• ISSN: 0302-9743; 1611-3349
• DOI: 10.1007/11752578_36

This paper presents a high level description of Domus, an architecture for cluster-oriented Distributed Hash Tables. As a data management layer, Domus supports the concurrent execution of multiple and heterogeneous DHTs, that may be simultaneously accessed by different distributed/parallel client applications. At system level, a load balancement mechanism allows for the (re)distribution of each DHT over cluster nodes, based on the monitoring of their resources, including CPUs, memory, storage and network. Two basic units of balancement are supported: vnodes, a coarse-grain unit, and partitions, a fine-grain unit. The design also takes advantage of the strict separation of object lookup and storage, at each cluster node, and for each DHT. Lookup follows a distributed strategy that benefits from the joint analysis of multiple partition-specific routing information, to shorten routing paths. Storage is accomplished through different kinds of data repositories, according to the specificity and requirements of each DHT.