Storage-Heterogeneity Aware Task-based Programming Models to Optimize I/O Intensive Applications

• Published in: IEEE transactions on parallel and distributed systems Vol. 33; no. 12; pp. 3589 - 3599
• Main Authors: Elshazly, Hatem, Ejarque, Jorge, Badia, Rosa M.
• Format: Journal Article
• Language: English
• Published: New York IEEE 01.12.2022; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: automatic data movement; Bandwidth; Big Data; checkpointing; Computational modeling; Heterogeneity; heterogeneity abstraction; Heterogeneous storage systems; I/O intensive applications; I/O scheduling; Optimization; Performance evaluation; Programming; Proposals; Random access memory; resource pooling; Storage systems; Task analysis; task scheduling; task-based programming models
• ISSN: 1045-9219; 1558-2183
• DOI: 10.1109/TPDS.2022.3161123

Task-based programming models have enabled the optimized execution of the computation workloads of applications. These programming models can take advantage of large-scale distributed infrastructures by allowing the parallel and distributed execution of applications in high-level work components called tasks . Nevertheless, in the era of Big Data and Exascale, the amount of data produced by modern scientific applications has already surpassed terabytes and is rapidly increasing. Hence, I/O performance became the bottleneck to overcome in order to achieve more total performance improvement. New storage technologies offer higher bandwidth and faster solutions than traditional Parallel File Systems (PFS). Such storage devices are deployed in modern day infrastructures to boost I/O performance by offering a fast layer that absorbs the generated data. Therefore, it is necessary for any programming model targeting more performance to manage this heterogeneity and take advantage of it to improve the I/O performance of applications. Towards this goal, we propose in this article a set of programming model capabilities that we refer to as Storage-Heterogeneity Awareness . Such capabilities include: (i) abstracting the heterogeneity of storage systems, and (ii) optimizing I/O performance by supporting dedicated I/O schedulers and an automatic data flushing technique. The evaluation section of this article presents the performance results of different applications on the MareNostrum CTE-Power heterogeneous storage cluster. Our experiments demonstrate that a storage-heterogeneity aware programming model can achieve up to almost 5x I/O performance speedup and 48% total time improvement compared to the reference PFS-based usage of the execution infrastructure.