Multiple comparison procedures applied to model selection

This paper presents a new approach to model selection based on hypothesis testing. We first describe a procedure to generate different scores for any candidate model from a single sample of training data and then discuss how to apply multiple comparison procedures (MCP) to model selection. MCP stati...

Full description

Saved in:
Bibliographic Details
Published inNeurocomputing (Amsterdam) Vol. 48; no. 1; pp. 155 - 173
Main Authors Pizarro, Joaquı́n, Guerrero, Elisa, Galindo, Pedro L.
Format Journal Article
LanguageEnglish
Published Elsevier B.V 01.10.2002
Subjects
Generalization
Model selection
Multiple comparison procedures
Network size
Problem complexity
Network size
Problem complexity
Generalization
Model selection
Multiple comparison procedures
Online AccessGet full text

Cover

More Information
Summary:This paper presents a new approach to model selection based on hypothesis testing. We first describe a procedure to generate different scores for any candidate model from a single sample of training data and then discuss how to apply multiple comparison procedures (MCP) to model selection. MCP statistical tests allow us to compare three or more groups of data while controlling the probability of making at least one Type I error. The complete procedure is illustrated on several model selection tasks, including the determination of the number of hidden units for feed-forward neural networks and the number of kernels for RBF networks.
ISSN:0925-2312
1872-8286
DOI:10.1016/S0925-2312(01)00653-1