Pattern classification with ordered features using mRMR and neural networks

• Published in: 2010 International Conference on Information, Networking and Automation (ICINA) Vol. 2; pp. V2-128 - V2-131
• Main Authors: Ting Wang, Yuanqian Wang
• Format: Conference Proceeding
• Language: English
• Published: IEEE 01.10.2010
• Subjects: Analytical models; Calculators; Cancer; Computational modeling; feature ordering; incremental attribute learning; ITID; mRMR; neural networks; Predictive models
• ISBN: 142448104X; 9781424481040
• ISSN: 2162-5476; 2162-5484
• DOI: 10.1109/ICINA.2010.5636963

Feature selection and feature extraction are widely used feature reduction approaches which are insufficient for coping with high-dimensional pattern classification problems when all features of the problem have the same significance. A proved useful method for solving this problem is incremental attribute learning (IAL) which gradually trains input features in one or more size. Hence a new preprocessing called feature ordering should be introduced in pattern classification. In previous IAL studies of pattern classification, feature ordering was ranked by discrimination ability which was derived from a neural network with a single input and all outputs. Such a method which is similar to wrappers in feature selection is applicable for high-dimensional pattern classification problems. However, due to the fact that it is time-consuming, a substitute approach for feature ordering is presented in this paper, where feature ordering is ranked by redundancy and relevance using mRMR method. Experimental results show that feature ordering derived by mRMR can not only save time, but also obtain the best classification rate based on ITID, a neural IAL model, compared with those in previous studies.