DHTbd: A Reliable Block-Based Storage System for High Performance Clusters

Large, reliable and efficient storage systems are becoming increasingly important in enterprise environments. Our research in storage system design is oriented towards the exploitation of commodity hardware for building a high performance, resilient and scalable storage system. We present the design...

Full description

Saved in:
Bibliographic Details
Published in2011 11th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing pp. 392 - 401
Main Authors Parisis, G., Xylomenos, G., Apostolopoulos, T.
Format Conference Proceeding
LanguageEnglish
Published IEEE 01.05.2011
Subjects
distributed hash tables
distributed storage
Driver circuits
Hardware
Operating systems
Performance evaluation
resilient storage
Routing
Servers
Tin
Online AccessGet full text

Cover

More Information
Summary:Large, reliable and efficient storage systems are becoming increasingly important in enterprise environments. Our research in storage system design is oriented towards the exploitation of commodity hardware for building a high performance, resilient and scalable storage system. We present the design and implementation of DHTbd, a general purpose decentralized storage system where storage nodes support a distributed hash table based interface and clients are implemented as in-kernel device drivers. DHTbd, unlike most storage systems proposed to date, is implemented at the block device level of the I/O stack, a simple yet efficient design. The experimental evaluation of the proposed system demonstrates its very good I/O performance, its ability to scale to large clusters, as well as its robustness, even when massive failures occur.
ISBN:1457701294
9781457701290
DOI:10.1109/CCGrid.2011.59