E-CIDIM: Ensemble of CIDIM Classifiers

• Published in: Advanced Data Mining and Applications pp. 108 - 117
• Main Authors: Ramos-Jiménez, Gonzalo, del Campo-Ávila, José, Morales-Bueno, Rafael
• Format: Book Chapter Conference Proceeding
• Language: English
• Published: Berlin, Heidelberg Springer Berlin Heidelberg 2005; Springer
• Series: Lecture Notes in Computer Science
• Subjects: Applied sciences; Computer science; control theory; systems; Data processing. List processing. Character string processing; Exact sciences and technology; Memory organisation. Data processing; Software; Data analysis; Statistical analysis; Algorithm performance; Classification; Data mining; Learning algorithm; Decision tree; Artificial intelligence; Construction system; Confidence interval; Aggregate model
• ISBN: 354027894X; 9783540278948
• ISSN: 0302-9743; 1611-3349
• DOI: 10.1007/11527503_14

An active research area in Machine Learning is the construction of multiple classifier systems to increase learning accuracy of simple classifiers. In this paper we present E-CIDIM, a multiple classifier system designed to improve the performance of CIDIM, an algorithm that induces small and accurate decision trees. E-CIDIM keeps a maximum number of trees and it induces new trees that may substitute the old trees in the ensemble. The substitution process finishes when none of the new trees improves the accuracy of any of the trees in the ensemble after a pre-configured number of attempts. In this way, the accuracy obtained thanks to an unique instance of CIDIM can be improved. In reference to the accuracy of the generated ensembles, E-CIDIM competes well against bagging and boosting at statistically significance confidence levels and it usually outperforms them in the accuracy and the average size of the trees in the ensemble.