Multi-objective Performance Measurement: Alternatives to PAR10 and Expected Running Time

A multiobjective perspective onto common performance measures such as the PAR10 score or the expected runtime of single-objective stochastic solvers is presented by directly investigating the tradeoff between the fraction of failed runs and the average runtime. Multi-objective indicators operating i...

Full description

Saved in:
Bibliographic Details
Published inLearning and Intelligent Optimization Vol. 11353; pp. 215 - 219
Main Authors Bossek, Jakob, Trautmann, Heike
Format Book Chapter
LanguageEnglish
Published Switzerland Springer International Publishing AG 01.01.2019
Springer International Publishing
SeriesLecture Notes in Computer Science
Subjects
Algorithm selection
Performance measurement
Online AccessGet full text

Cover

More Information
Summary:A multiobjective perspective onto common performance measures such as the PAR10 score or the expected runtime of single-objective stochastic solvers is presented by directly investigating the tradeoff between the fraction of failed runs and the average runtime. Multi-objective indicators operating in the bi-objective space allow for an overall performance comparison on a set of instances paving the way for instance-based automated algorithm selection techniques.
ISBN:3030053474
9783030053475
ISSN:0302-9743
1611-3349
DOI:10.1007/978-3-030-05348-2_19