A correlation-aware data placement strategy for key-value stores

• Published in: Proceedings of the 11th IFIP WG 6.1 international conference on Distributed applications and interoperable systems pp. 214 - 227
• Main Authors: Vilaça, Ricardo, Oliveira, Rui, Pereira, José
• Format: Conference Proceeding
• Language: English
• Published: Berlin, Heidelberg Springer-Verlag 06.06.2011
• Series: ACM Conferences
• Subjects: Computer systems organization; Computer systems organization > Architectures; Computer systems organization > Architectures > Distributed architectures; Computer systems organization > Dependable and fault-tolerant systems and networks; General and reference; General and reference > Cross-computing tools and techniques; General and reference > Cross-computing tools and techniques > Performance; Networks; Networks > Network performance evaluation; Software and its engineering; Software and its engineering > Software organization and properties; Software and its engineering > Software organization and properties > Software system structures; Software and its engineering > Software organization and properties > Software system structures > Distributed systems organizing principles; DHT; cloud computing; dependability; peer-to-peer
• ISBN: 3642213863; 9783642213861
• DOI: 10.5555/2022090.2022107

Key-value stores hold the unprecedented bulk of the data produced by applications such as social networks. Their scalability and availability requirements often outweigh sacrificing richer data and processing models, and even elementary data consistency. Moreover, existing key-value stores have only random or order based placement strategies. In this paper we exploit arbitrary data relations easily expressed by the application to foster data locality and improve the performance of complex queries common in social network read-intensive workloads. We present a novel data placement strategy, supporting dynamic tags, based on multidimensional locality-preserving mappings. We compare our data placement strategy with the ones used in existing key-value stores under the workload of a typical social network application and show that the proposed correlation-aware data placement strategy offers a major improvement on the system's overall response time and network requirements.