GIFT: A Real-Time and Scalable 3D Shape Search Engine

• Published in: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) pp. 5023 - 5032
• Main Authors: Song Bai, Xiang Bai, Zhichao Zhou, Zhaoxiang Zhang, Latecki, Longin Jan
• Format: Conference Proceeding
• Language: English
• Published: IEEE 01.06.2016
• Subjects: Acceleration; Feature extraction; Graphics processing units; Real-time systems; Search engines; Shape; Three-dimensional displays
• ISSN: 1063-6919
• DOI: 10.1109/CVPR.2016.543

Projective analysis is an important solution for 3D shape retrieval, since human visual perceptions of 3D shapes rely on various 2D observations from different view points. Although multiple informative and discriminative views are utilized, most projection-based retrieval systems suffer from heavy computational cost, thus cannot satisfy the basic requirement of scalability for search engines. In this paper, we present a real-time 3D shape search engine based on the projective images of 3D shapes. The real-time property of our search engine results from the following aspects: (1) efficient projection and view feature extraction using GPU acceleration, (2) the first inverted file, referred as F-IF, is utilized to speed up the procedure of multi-view matching, (3) the second inverted file (S-IF), which captures a local distribution of 3D shapes in the feature manifold, is adopted for efficient context-based reranking. As a result, for each query the retrieval task can be finished within one second despite the necessary cost of IO overhead. We name the proposed 3D shape search engine, which combines GPU acceleration and Inverted File (Twice), as GIFT. Besides its high efficiency, GIFT also outperforms the state-of-the-art methods significantly in retrieval accuracy on various shape benchmarks and competitions.