Better GP benchmarks: community survey results and proposals

We present the results of a community survey regarding genetic programming benchmark practices. Analysis shows broad consensus that improvement is needed in problem selection and experimental rigor. While views expressed in the survey dissuade us from proposing a large-scale benchmark suite, we find...

Full description

Saved in:
Bibliographic Details
Published inGenetic programming and evolvable machines Vol. 14; no. 1; pp. 3 - 29
Main Authors White, David R., McDermott, James, Castelli, Mauro, Manzoni, Luca, Goldman, Brian W., Kronberger, Gabriel, Jaśkowski, Wojciech, O’Reilly, Una-May, Luke, Sean
Format Journal Article
LanguageEnglish
Published Boston Springer US 01.03.2013
Subjects
Artificial Intelligence
Benchmarks
Biomedical Engineering and Bioengineering
Communities
Compilers
Computer Science
Defects
Electrical Engineering
Genetics
Interpreters
Programming
Programming Languages
Programming Techniques
Proposals
Software Engineering/Programming and Operating Systems
Benchmarks
Community survey
Genetic programming
Online AccessGet full text

Cover

More Information
Summary:We present the results of a community survey regarding genetic programming benchmark practices. Analysis shows broad consensus that improvement is needed in problem selection and experimental rigor. While views expressed in the survey dissuade us from proposing a large-scale benchmark suite, we find community support for creating a “blacklist” of problems which are in common use but have important flaws, and whose use should therefore be discouraged. We propose a set of possible replacement problems.
Bibliography:ObjectType-Article-2
SourceType-Scholarly Journals-1
ObjectType-Feature-1
content type line 23
ISSN:1389-2576
1573-7632
DOI:10.1007/s10710-012-9177-2