De-Hashing: Server-Side Context-Aware Feature Reconstruction for Mobile Visual Search

Due to the prevalence of mobile devices, mobile search becomes a more convenient way than desktop search. Different from the traditional desktop search, mobile visual search needs more consideration for the limited resources on mobile devices (e.g., bandwidth, computing power, and memory consumption...

Full description

Saved in:
Bibliographic Details
Published inarXiv.org
Main Authors Yin-Hsi Kuo, Hsu, Winston H
Format Paper
LanguageEnglish
Published Ithaca Cornell University Library, arXiv.org 29.06.2016
Subjects
Ambient intelligence
Binary codes
Cloud computing
Computer memory
Electronic devices
Mobile communication systems
Object recognition
Power consumption
Product development
Representations
Retrieval
Searching
Servers
Target recognition
Wireless networks
Online AccessGet full text

Cover

More Information
Summary:Due to the prevalence of mobile devices, mobile search becomes a more convenient way than desktop search. Different from the traditional desktop search, mobile visual search needs more consideration for the limited resources on mobile devices (e.g., bandwidth, computing power, and memory consumption). The state-of-the-art approaches show that bag-of-words (BoW) model is robust for image and video retrieval; however, the large vocabulary tree might not be able to be loaded on the mobile device. We observe that recent works mainly focus on designing compact feature representations on mobile devices for bandwidth-limited network (e.g., 3G) and directly adopt feature matching on remote servers (cloud). However, the compact (binary) representation might fail to retrieve target objects (images, videos). Based on the hashed binary codes, we propose a de-hashing process that reconstructs BoW by leveraging the computing power of remote servers. To mitigate the information loss from binary codes, we further utilize contextual information (e.g., GPS) to reconstruct a context-aware BoW for better retrieval results. Experiment results show that the proposed method can achieve competitive retrieval accuracy as BoW while only transmitting few bits from mobile devices.
ISSN:2331-8422