Network topology optimization for data aggregation with splitting

• Published in: IEEE International Symposium on Signal Processing and Information Technology pp. 000398 - 000403
• Main Authors: Das, Soham, Sahni, Sartaj
• Format: Conference Proceeding
• Language: English
• Published: IEEE 01.12.2014
• Subjects: Approximation algorithms; Big Data applications; Clustering algorithms; Complexity theory; Data Center Networks; Map-Reduce tasks; Network topology; Optical fiber communication; Optical switches; Software Defined networking; Topology

In this paper, we develop algorithms for the data aggregation problem which arises in the context of big-data applications that employ the MapReduce operation. For the case when source racks can send their data to the aggregator using multiple paths, we show that an aggregation tree topology that mi...