Combining pixel domain and compressed domain index for sketch based image retrieval

• Published in: Multimedia tools and applications Vol. 76; no. 21; pp. 22019 - 22042
• Main Authors: Pimentel Filho, Carlos Alberto Fraga, Bustos, Benjamin, Araújo, Arnaldo de Albuquerque, Guimarães, Silvio Jamil Ferzoli
• Format: Journal Article
• Language: English
• Published: New York Springer US 01.11.2017; Springer Nature B.V
• Subjects: Computer Communication Networks; Computer Science; Contours; Data Structures and Information Theory; Image management; Image retrieval; Lists; Multimedia Information Systems; Pixels; Sketches; Special Purpose and Application-Based Systems; Wavelet analysis; Sketch-based image retrieval; Multimedia indexing; Scalability
• ISSN: 1380-7501; 1573-7721
• DOI: 10.1007/s11042-017-4758-y

Sketch-based image retrieval (SBIR) lets one express a precise visual query with simple and widespread means. In the SBIR approaches, the challenge consists in representing the image dataset features in a structure that allows one to efficiently and effectively retrieve images in a scalable system. We put forward a sketch-based image retrieval solution where sketches and natural image contours are represented and compared, in both, the compressed-domain of wavelet and in the pixel domain. The query is efficiently performed in the wavelet domain, while effectiveness refinements are achieved using the pixel domain to verify the spatial consistency between the sketch strokes and the natural image contours. Also, we present an efficient scheme of inverted lists for sketch-based image retrieval using the compressed-domain of wavelets. Our proposal of indexing presents two main advantages, the amount of the data to compute the query is smaller than the traditional method while it presents a better effectiveness.