Multi-objective Performance Measurement: Alternatives to PAR10 and Expected Running Time

• Published in: Learning and Intelligent Optimization Vol. 11353; pp. 215 - 219
• Main Authors: Bossek, Jakob, Trautmann, Heike
• Format: Book Chapter
• Language: English
• Published: Switzerland Springer International Publishing AG 01.01.2019; Springer International Publishing
• Series: Lecture Notes in Computer Science
• Subjects: Algorithm selection; Performance measurement

A multiobjective perspective onto common performance measures such as the PAR10 score or the expected runtime of single-objective stochastic solvers is presented by directly investigating the tradeoff between the fraction of failed runs and the average runtime. Multi-objective indicators operating i...