Understanding Objects in Detail with Fine-Grained Attributes

• Published in: 2014 IEEE Conference on Computer Vision and Pattern Recognition pp. 3622 - 3629
• Main Authors: Vedaldi, Andrea, Mahendran, Siddharth, Tsogkas, Stavros, Maji, Subhransu, Girshick, Ross, Kannala, Juho, Rahtu, Esa, Kokkinos, Iasonas, Blaschko, Matthew B., Weiss, David, Taskar, Ben, Simonyan, Karen, Saphra, Naomi, Mohamed, Sammy
• Format: Conference Proceeding Journal Article
• Language: English
• Published: IEEE 01.06.2014
• Subjects: Aircraft components; Airplanes; Algorithms; Arrays; Atmospheric modeling; attribute; Cascades; Categories; coarse to fine; Computer vision; crowd sourcing; dataset; Nose; object description; Object detection; Object recognition; part; Pattern recognition; Semantics; Shape; Visualization
• ISSN: 1063-6919; 1063-6919
• DOI: 10.1109/CVPR.2014.463

We study the problem of understanding objects in detail, intended as recognizing a wide array of fine-grained object attributes. To this end, we introduce a dataset of 7, 413 airplanes annotated in detail with parts and their attributes, leveraging images donated by airplane spotters and crowd-sourcing both the design and collection of the detailed annotations. We provide a number of insights that should help researchers interested in designing fine-grained datasets for other basic level categories. We show that the collected data can be used to study the relation between part detection and attribute prediction by diagnosing the performance of classifiers that pool information from different parts of an object. We note that the prediction of certain attributes can benefit substantially from accurate part detection. We also show that, differently from previous results in object detection, employing a large number of part templates can improve detection accuracy at the expenses of detection speed. We finally propose a coarse-to-fine approach to speed up detection through a hierarchical cascade algorithm.