Applying a new localized generalization error model to design neural networks trained with extreme learning machine

• Published in: Neural computing & applications Vol. 27; no. 1; pp. 59 - 66
• Main Authors: Liu, Qiang, Yin, Jianping, Leung, Victor C. M., Zhai, Jun-Hai, Cai, Zhiping, Lin, Jiarun
• Format: Journal Article
• Language: English
• Published: London Springer London 01.01.2016
• Subjects: Artificial Intelligence; Computational Biology/Bioinformatics; Computational Science and Engineering; Computer Science; Data Mining and Knowledge Discovery; Extreme Learning Machine and Applications; Image Processing and Computer Vision; Probability and Statistics in Computer Science; Localized generalization error model; Extreme learning machine; Architecture selection algorithm; Principal component analysis
• ISSN: 0941-0643; 1433-3058
• DOI: 10.1007/s00521-014-1549-5

High accuracy and low overhead are two key features of a well-designed classifier for different classification scenarios. In this paper, we propose an improved classifier using a single-hidden layer feedforward neural network (SLFN) trained with extreme learning machine. The novel classifier first utilizes principal component analysis to reduce the feature dimension and then selects the optimal architecture of the SLFN based on a new localized generalization error model in the principal component space. Experimental and statistical results on the NSL-KDD data set demonstrate that the proposed classifier can achieve a significant performance improvement compared with previous classifiers.