An Extreme Learning Machine Architecture Based on Volterra Filtering and PCA

• Published in: IEICE Transactions on Information and Systems Vol. E100.D; no. 11; pp. 2690 - 2701
• Main Authors: CHEN, Li, YANG, Ling, DU, Juan, SUN, Chao, DU, Shenglei, XI, Haipeng
• Format: Journal Article
• Language: English
• Published: Tokyo The Institute of Electronics, Information and Communication Engineers 01.01.2017; Japan Science and Technology Agency
• Subjects: Adequacy; Architecture; Equalization; extreme learning machines; Filtration; Learning; Neural networks; Performance evaluation; principal component analysis; Principal components analysis; Signal processing; support vector machine; Support vector machines; unsupervised equalization; Volterra filter
• ISSN: 0916-8532; 1745-1361
• DOI: 10.1587/transinf.2017EDP7089

Extreme learning machine (ELM) has recently attracted many researchers' interest due to its very fast learning speed, good generalization ability, and ease of implementation. However, it has a linear output layer which may limit the capability of exploring the available information, since higher-order statistics of the signals are not taken into account. To address this, we propose a novel ELM architecture in which the linear output layer is replaced by a Volterra filter structure. Additionally, the principal component analysis (PCA) technique is used to reduce the number of effective signals transmitted to the output layer. This idea not only improves the processing capability of the network, but also preserves the simplicity of the training process. Then we carry out performance evaluation and application analysis for the proposed architecture in the context of supervised classification and unsupervised equalization respectively, and the obtained results either on publicly available datasets or various channels, when compared to those produced by already proposed ELM versions and a state-of-the-art algorithm: support vector machine (SVM), highlight the adequacy and the advantages of the proposed architecture and characterize it as a promising tool to deal with signal processing tasks.