多标签代价敏感分类集成学习算法
尽管多标签分类问题可以转换成一般多分类问题解决，但多标签代价敏感分类问题却很难转换成多类代价敏感分类问题．通过对多分类代价敏感学习算法扩展为多标签代价敏感学习算法时遇到的一些问题进行分析，提出了一种多标签代价敏感分类集成学习算法．算法的平均错分代价为误检标签代价和漏检标签代价之和，算法的流程类似于自适应提升（Adaptive boosting，AdaBoost）算法，其可以自动学习多个弱分类器来组合成强分类器，强分类器的平均错分代价将随着弱分类器增加而逐渐降低．详细分析了多标签代价敏感分类集成学习算法和多类代价敏感AdaBoost算法的区别，包括输出标签的依据和错分代价的含义．不同于通常的多类...
Saved in:
| Published in | 自动化学报 Vol. 40; no. 6; pp. 1075 - 1085 |
|---|---|
| Main Author | |
| Format | Journal Article |
| Language | Chinese |
| Published |
中国科学院成都计算机应用研究所 成都 610041
2014
|
| Subjects | |
| Online Access | Get full text |
Cover
Loading…
| Summary: | 尽管多标签分类问题可以转换成一般多分类问题解决，但多标签代价敏感分类问题却很难转换成多类代价敏感分类问题．通过对多分类代价敏感学习算法扩展为多标签代价敏感学习算法时遇到的一些问题进行分析，提出了一种多标签代价敏感分类集成学习算法．算法的平均错分代价为误检标签代价和漏检标签代价之和，算法的流程类似于自适应提升（Adaptive boosting，AdaBoost）算法，其可以自动学习多个弱分类器来组合成强分类器，强分类器的平均错分代价将随着弱分类器增加而逐渐降低．详细分析了多标签代价敏感分类集成学习算法和多类代价敏感AdaBoost算法的区别，包括输出标签的依据和错分代价的含义．不同于通常的多类代价敏感分类问题，多标签代价敏感分类问题的错分代价要受到一定的限制，详细分析并给出了具体的限制条件．简化该算法得到了一种多标签AdaBoost算法和一种多类代价敏感AdaBoost算法．理论分析和实验结果均表明提出的多标签代价敏感分类集成学习算法是有效的，该算法能实现平均错分代价的最小化．特别地，对于不同类错分代价相差较大的多分类问题，该算法的效果明显好于已有的多类代价敏感AdaBoost算法． |
|---|---|
| Bibliography: | Although a multi-label classification problem can be converted into a multi-class classification problem to solve, it is dimcult that a multi-label cost-sensitive classification problem is converted into a multi-class cost-sensitive classification problem. A cost-sensitive ensemble learning algorithm for multi-label classification problems is proposed based on the analysis on the problems encountered when the multi-class cost-sensitive learning algorithm being extended to multi-label cost-sensitive learning algorithms. The average misclassification cost of the algorithm is composed of fall-out cost and the omission cost. The new algorithmts process is similar to the adaptive boosting （AdaBoost）algorithm, and the algorithm can automatically learn some weak classifiers and combine them into a strong classifier, and the average misclassification cost of the strong classifier will decrease as the weak classifiers gradually increase. The distinction between the cost- sensitive ensemble learning algorithm for multi |
| ISSN: | 0254-4156 1874-1029 |
| DOI: | 10.3724/SP.J.1004.2014.01075 |