Efficient Multiple Instance Metric Learning Using Weakly Supervised Data

• Published in: 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) pp. 5948 - 5956
• Main Authors: Law, Marc T., Yaoliang Yu, Urtasun, Raquel, Zemel, Richard S., Xing, Eric P.
• Format: Conference Proceeding
• Language: English
• Published: IEEE 01.07.2017
• Subjects: Conferences; Face recognition; Measurement; Optimization; Symmetric matrices; Training
• ISSN: 1063-6919
• DOI: 10.1109/CVPR.2017.630

We consider learning a distance metric in a weakly supervised setting where bags (or sets) of instances are labeled with bags of labels. A general approach is to formulate the problem as a Multiple Instance Learning (MIL) problem where the metric is learned so that the distances between instances inferred to be similar are smaller than the distances between instances inferred to be dissimilar. Classic approaches alternate the optimization over the learned metric and the assignment of similar instances. In this paper, we propose an efficient method that jointly learns the metric and the assignment of instances. In particular, our model is learned by solving an extension of k-means for MIL problems where instances are assigned to categories depending on annotations provided at bag-level. Our learning algorithm is much faster than existing metric learning methods for MIL problems and obtains state-of-the-art recognition performance in automated image annotation and instance classification for face identification.