A Comparison of Parallel Graph Processing Implementations

• Published in: arXiv.org
• Main Authors: Pollard, Samuel, Norris, Boyana
• Format: Paper
• Language: English
• Published: Ithaca Cornell University Library, arXiv.org 17.05.2017
• Subjects: Energy consumption; Network analysis; Packages; Search algorithms; Search engines; Source code

The rapidly growing number of large network analysis problems has led to the emergence of many parallel and distributed graph processing systems---one survey in 2014 identified over 80. Since then, the landscape has evolved; some packages have become inactive while more are being developed. Determining the best approach for a given problem is infeasible for most developers. To enable easy, rigorous, and repeatable comparison of the capabilities of such systems, we present an approach and associated software for analyzing the performance and scalability of parallel, open-source graph libraries. We demonstrate our approach on five graph processing packages: GraphMat, the Graph500, the Graph Algorithm Platform Benchmark Suite, GraphBIG, and PowerGraph using synthetic and real-world datasets. We examine previously overlooked aspects of parallel graph processing performance such as phases of execution and energy usage for three algorithms: breadth first search, single source shortest paths, and PageRank and compare our results to Graphalytics.