A Unified Framework for Metric Transfer Learning

• Published in: IEEE transactions on knowledge and data engineering Vol. 29; no. 6; pp. 1158 - 1171
• Main Authors: Yonghui Xu, Pan, Sinno Jialin, Hui Xiong, Qingyao Wu, Ronghua Luo, Huaqing Min, Hengjie Song
• Format: Journal Article
• Language: English
• Published: New York IEEE 01.06.2017; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: density ratio reweighting; Divergence; Domains; Euclidean distance; Euclidean geometry; Handwriting; Handwriting recognition; Kernel; Knowledge management; Knowledge transfer; Learning; learning framework; Learning systems; Mahalanobis distance; metric learning; Mobile handsets; Object recognition; State of the art; Training data; Transfer learning
• ISSN: 1041-4347; 1558-2191
• DOI: 10.1109/TKDE.2017.2669193

Transfer learning has been proven to be effective for the problems where training data from a source domain and test data from a target domain are drawn from different distributions. To reduce the distribution divergence between the source domain and the target domain, many previous studies have been focused on designing and optimizing objective functions with the Euclidean distance to measure dissimilarity between instances. However, in some real-world applications, the Euclidean distance may be inappropriate to capture the intrinsic similarity or dissimilarity between instances. To deal with this issue, in this paper, we propose a metric transfer learning framework (MTLF) to encode metric learning in transfer learning. In MTLF, instance weights are learned and exploited to bridge the distributions of different domains, while Mahalanobis distance is learned simultaneously to maximize the intra-class distances and minimize the inter-class distances for the target domain. Unlike previous work where instance weights and Mahalanobis distance are trained in a pipelined framework that potentially leads to error propagation across different components, MTLF attempts to learn instance weights and a Mahalanobis distance in a parallel framework to make knowledge transfer across domains more effective. Furthermore, we develop general solutions to both classification and regression problems on top of MTLF, respectively. We conduct extensive experiments on several real-world datasets on object recognition, handwriting recognition, and WiFi location to verify the effectiveness of MTLF compared with a number of state-of-the-art methods.