MPI-2 One-Sided Usage and Implementation for Read Modify Write Operations: A Case Study with HPCC

• Published in: Recent Advances in Parallel Virtual Machine and Message Passing Interface pp. 251 - 259
• Main Authors: Santhanaraman, Gopalakrishnan, Narravula, Sundeep, Mamidala, Amith. R., Panda, Dhabaleswar K.
• Format: Book Chapter
• Language: English
• Published: Berlin, Heidelberg Springer Berlin Heidelberg
• Series: Lecture Notes in Computer Science
• Subjects: Atomic Operation; Communication Operation; Remote Memory; Remote Node; Software Aggregation
• DOI: 10.1007/978-3-540-75416-9_36
• ISBN: 9783540754152; 3540754156
• ISSN: 0302-9743

MPI-2’s One-sided communication interface is being explored in scientific applications. One of the important operations in a one sided model is read-modify-write. MPI-2 semantics provide MPI_Put, MPI_Get and MPI_Accumulate operations which can be used to implement read-modify-write functionality. The different strategies yield varying performance benefits depending on the underlying one-sided implementation. We use HPCC Random Access benchmark which primarily uses read-modify-write operations as a case study for evaluating the different implementation strategies in this paper. Currently this benchmark is implemented based on MPI two-sided semantics. In this work we design and evaluate MPI-2 versions of the HPCC Random Access benchmark using one-sided operations. To improve the performance, we explore two different optimizations: (i) software based aggregation and (ii) hardware-based atomic operations. We evaluate our different approaches on an InfiniBand cluster. The software based aggregation outperforms the basic one sided scheme without aggregation by a factor of 4.38. The hardware based scheme shows an improvement by a factor of 2.62 as compared to the basic one sided scheme.