A study on output normalization in multiclass SVMs

• Published in: Pattern recognition letters Vol. 34; no. 3; pp. 344 - 348
• Main Authors: Gonzalez-Abril, L., Velasco, F., Angulo, C., Ortega, J.A.
• Format: Journal Article Publication
• Language: English
• Published: Elsevier B.V 01.02.2013
• Subjects: 1-v-r SVM; Aprenentatge automàtic; Autoaprenentatge; Convex hull; Enginyeria electrònica; Informàtica; Intel·ligència artificial; Kernel functions; Kernel methods; Kernel, Funcions de; Machine learning; Mathematical models; Microelectrònica; Multiclassification; Sistemes digitals programables; Sistemes experts (Informàtica); Support vector machines; Àrees temàtiques de la UPC; Kernel methods; Multiclassification; Convex hull; 1-v-r SVM
• ISSN: 0167-8655; 1872-7344
• DOI: 10.1016/j.patrec.2012.11.003

► This normalization overcomes the scaling problem in multi-classification with SVMs. ► It does not require additional steps of re-training. ► The keypoint is the use of the convex hulls that contain the classes to be separated. ► In some cases, the accuracy rate can be improved with respect to non-normalization. The use of binary support vector machines (SVMs) in multi-classification is addressed in this paper. Margins associated to the bi-classifiers, since they depend on the geometrical disposition of the classes being separated, are, in general, of various magnitudes. In order to overcome this scaling problem, a normalization process should be applied on the SVMs’ outputs. Thus, a new normalization approach is presented based on the convex hulls that contain the classes to be separated. Furthermore, a theoretical study is developed which justifies the proposed approach, and an interpretation is provided. An empirical study is also carried out to compare this normalization with others found in the literature.