Commodity Image Retrieval Method Based on CNN and Score Fusion

Content-based image retrieval (CBIR) is an important research direction of computer vision and has been well studied for a long period. The important aim in CBIR is to reduce the semantic gap issue that improves the performance of image retrieval. It plays an important role in the field of e-commerc...

Full description

Saved in:
Bibliographic Details
Published in2021 International Conference on Culture-oriented Science & Technology (ICCST) pp. 453 - 457
Main Authors Liu, Zihao, Wu, Xiaoyu, Qian, Jiayao, Zhu, Zhiyi
Format Conference Proceeding
LanguageEnglish
Published IEEE 01.11.2021
Subjects
CBIR
CNN
Data models
Feature extraction
Image color analysis
Image retrieval
Semantics
Transfer learning
Visualization
Online AccessGet full text

Cover

More Information
Summary:Content-based image retrieval (CBIR) is an important research direction of computer vision and has been well studied for a long period. The important aim in CBIR is to reduce the semantic gap issue that improves the performance of image retrieval. It plays an important role in the field of e-commerce. This paper proposes a CBIR method based on ResNet and EfficientNet, and conducts experiments on the dataset of eProduct Visual Search Challenge 2021. First, because the dataset lacks direct query-index tags and the categories are not balanced, transfer learning is used to fine-tune the model with a balanced sub-dataset constructed by data augmentation. Second, the semantic features are extracted by the ResNet and EfficientNet and similarity comparison is calculated between the query and index image. Finally, the similarity result is decided through fusing the scores obtained by the two CNNs through a strategy. Experiments on the eProduct dataset demonstrate our algorithm can achieve a good performance.
DOI:10.1109/ICCST53801.2021.00101