Data Management in Large-Scale P2P Systems

• Published in: High Performance Computing for Computational Science - VECPAR 2004 pp. 104 - 118
• Main Authors: Valduriez, Patrick, Pacitti, Esther
• Format: Book Chapter Conference Proceeding
• Language: English
• Published: Berlin, Heidelberg Springer Berlin Heidelberg 2005; Springer
• Series: Lecture Notes in Computer Science
• Subjects: Applied sciences; Computer science; control theory; systems; Computer systems and distributed systems. User interface; Data Integration System; Distribute Database System; Distribute Hash Table; Exact sciences and technology; Query Processing; Query Response Time; Software; Availability; High performance; Peer to peer; Coordination; Database query; Distributed database; File management; Distributed system; Distributed computing; Storage management; Size effect; Replication; Database management system; Operating system; Large scale system
• ISBN: 9783540254249; 3540254242
• ISSN: 0302-9743; 1611-3349
• DOI: 10.1007/11403937_9

Peer-to-peer (P2P) computing offers new opportunities for building highly distributed data systems. Unlike client-server computing, P2P can operate without central coordination and offer important advantages such as a very dynamic environment where peers can join and leave the network at any time; direct and fast communication between peers, and scale up to large number of peers. However, most deployed P2P systems have severe limitations: file-level sharing, read-only access, simple search and poor scaling. In this paper, we discuss the issues of providing high-level data management services (schema, queries, replication, availability, etc.) in a P2P system. This implies revisiting distributed database technology in major ways. We illustrate how we address some of these issues in the APPA data management system under development in the Atlas group.