HPC Software for Massive Analysis of the Parallel Efficiency of Applications

• Published in: Parallel Computational Technologies Vol. 1063; pp. 3 - 18
• Main Authors: Shvets, Pavel, Voevodin, Vadim, Zhumatiy, Sergey
• Format: Book Chapter
• Language: English
• Published: Switzerland Springer International Publishing AG 2019; Springer International Publishing
• Series: Communications in Computer and Information Science
• Subjects: Application performance; Efficiency analysis; Massive analysis; Parallel program; Supercomputing
• ISBN: 9783030281625; 3030281620
• ISSN: 1865-0929; 1865-0937
• DOI: 10.1007/978-3-030-28163-2_1

Efficiency is a major weakness in modern supercomputers. Low efficiency of user applications is one of the main reasons for that. There are many software tools for analyzing and improving the performance of parallel applications. However, supercomputer users often do not have sufficient knowledge and skills to apply these tools correctly in their specific case. Moreover, users often do not know that their applications work inefficiently. The main goal of our project is to help any HPC user to detect performance flaws in their applications and find out how to deal with them. To this end, we plan to develop an open-source software solution that performs automatic massive analysis of all jobs running on a supercomputer to identify those with efficiency issues and helps users to conduct a detailed analysis of an individual program (using existing software tools) to identify and eliminate the root causes of the loss of efficiency.