Modeling Distributed Platforms from Application Traces for Realistic File Transfer Simulation

Simulation is a fast, controlled, and reproducible way to evaluate new algorithms for distributed computing platforms in a variety of conditions. However, the realism of simulations is rarely assessed, which critically questions the applicability of a whole range of findings. In this paper, we prese...

Full description

Saved in:
Bibliographic Details
Published in2017 17th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGRID) pp. 54 - 63
Main Authors Chai, Anchen, Bazm, Mohammad-Mahdi, Camarasu-Pop, Sorina, Glatard, Tristan, Benoit-Cattin, Hugues, Sutern, Frédéric
Format Conference Proceeding
LanguageEnglish
Published Piscataway, NJ, USA IEEE Press 14.05.2017
IEEE
SeriesACM Conferences
Subjects
Bandwidth
Computational modeling
Delays
Hardware
Kernel
Numerical models
Silicon
Online AccessGet full text

Cover

More Information
Summary:Simulation is a fast, controlled, and reproducible way to evaluate new algorithms for distributed computing platforms in a variety of conditions. However, the realism of simulations is rarely assessed, which critically questions the applicability of a whole range of findings. In this paper, we present our efforts to build platform models from application traces, to allow for the accurate simulation of file transfers across a distributed infrastructure. File transfers are key to performance, as the variability of file transfer times has important consequences on the dataflow of the application. We present a methodology to build realistic platform models from application traces and provide a quantitative evaluation of the accuracy of the derived simulations. Results show that the proposed models are able to correctly capture real-life variability and significantly outperform the state-of-the-art model.
ISBN:9781509066100
1509066101
DOI:10.1109/CCGRID.2017.13