Multi-Dimensional Classification via Decomposed Label Encoding

• Published in: IEEE transactions on knowledge and data engineering Vol. 35; no. 2; pp. 1844 - 1856
• Main Authors: Jia, Bin-Bin, Zhang, Min-Ling
• Format: Journal Article
• Language: English
• Published: New York IEEE 01.02.2023; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Classification; Coding; Decomposition; Encoding; Heterogeneity; Label encoding; Labeling; Labelling; machine learning; Manifolds; Modelling; multi-dimensional classification; one-versus-one decomposition; Operating systems; Prediction models; Predictive models; Semantics; Training
• ISSN: 1041-4347; 1558-2191
• DOI: 10.1109/TKDE.2021.3100436

In multi-dimensional classification (MDC), a number of class variables are assumed in the output space with each of them specifying the class membership w.r.t. one heterogeneous class space. One major challenge in learning from MDC examples lies in the heterogeneity of class spaces, where the modeling outputs from different class spaces are not directly comparable. To tackle this problem, we propose a new strategy named decomposed label encoding, which enables modeling alignment for MDC in an encoded label space derived from one-versus-one (OvO) decomposition. Specifically, the original MDC output space is transformed into a ternary encoded label space by conducting OvO decomposition w.r.t. each class space. Then, the manifold structure in the feature space is exploited to enrich the labeling information in the encoded label space. Finally, the predictive model is induced by fitting the metric-aligned modeling outputs with enriched labeling information. Extensive experiments over twenty benchmark data sets clearly show the superiority of the proposed MDC strategy against state-of-the-art approaches.