New execution model for CAPE using multiple threads on multicore clusters

• Published in: ETRI journal Vol. 43; no. 5; pp. 825 - 834
• Main Authors: Do, Xuan Huyen, Ha, Viet Hai, Tran, Van Long, Renault, Eric
• Format: Journal Article
• Language: English
• Published: Electronics and Telecommunications Research Institute 01.10.2021; Electronics and Telecommunications Research Institute (ETRI); 한국전자통신연구원
• Subjects: checkpointing‐aided parallel execution; Computer Science; high‐performance computing; OpenMP; parallel computing; 전자/정보통신공학
• ISSN: 1225-6463; 2233-7326
• DOI: 10.4218/etrij.2020-0201

Based on its simplicity and user‐friendly characteristics, OpenMP has become the standard model for programming on shared‐memory architectures. Checkpointing‐aided parallel execution (CAPE) is an approach that utilizes the discontinuous incremental checkpointing technique (DICKPT) to translate and execute OpenMP programs on distributed‐memory architectures automatically. Currently, CAPE implements the OpenMP execution model by utilizing the DICKPT to distribute parallel jobs and their data to slave machines, and then collects the results after executing these distributed jobs. Although this model has been proven to be effective in terms of performance and compatibility with OpenMP on distributed‐memory systems, it cannot fully exploit the capabilities of multicore processors. This paper presents a novel execution model for CAPE that utilizes two levels of parallelism. In the proposed model, we add another level of parallelism in the form of multithreaded processes on slave machines with the goal of better exploiting their multicore CPUs. Initial experimental results presented near the end of this paper demonstrate that this model provides significantly enhanced CAPE performance.