Model oriented profiling of parallel programs

• Published in: Proceedings 10th Euromicro Workshop on Parallel, Distributed and Network-based Processing pp. 39 - 45
• Main Authors: Gonzalez, J.A., Leon, C., Roda, J.L., Printista, M.
• Format: Conference Proceeding
• Language: English
• Published: IEEE 2002
• Subjects: Algorithm design and analysis; Bandwidth; Computer architecture; Delay; Pattern recognition; Predictive models; Program processors; Proposals; Statistics; Timing
• ISBN: 9780769514444; 0769514448
• DOI: 10.1109/EMPDP.2002.994212

The prediction analysis model presented extends BSP to cover both oblivious synchronization and group partitioning. These generalizations imply that different processors may finish the same superstep at different times. The other consideration is that, even if the numbers of individual communication or computation operations in two stages are the same, the actual times for these two stages may differ. These differences are due to the separate nature of the operations or to the particular pattern followed by the messages. Even worse, the assumption that a constant number of machine instructions takes constant time is far from the truth. Current memory hierarchies imply that memory access vary from a few cycles to several thousands. A natural proposal is to associate a different proportionality constant with each basic block, and analogously, to associate different latencies and bandwidths with each "communication block". Unfortunately, to use this approach implies that the evaluation parameters not only depend on given architecture, but also reflect algorithm characteristics. Such parameter evaluation must be done for every algorithm. This is a heavy task, implying experiment design, timing, statistics, pattern recognition and multi-parameter fitting algorithms. Software support is required. We have developed a compiler that takes as source a C program annotated with complexity formulas and produces as output an instrumented code. The trace files obtained from the execution of the resulting code are analyzed with an interactive interpreter giving us, among other information, the values of those parameters.