Modeling Fashion Compatibility with Explanation by using Bidirectional LSTM

The goal of this paper is to model the fashion compatibility of an outfit and provide the explanations. We first extract features of all attributes of all items via convolutional neural networks, and then train the bidirectional Long Short-term Memory (Bi-LSTM) model to learn the compatibility of an...

Full description

Saved in:
Bibliographic Details
Published in2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) pp. 3889 - 3893
Main Authors Kaicheng, Pang, Xingxing, Zou, Wong, Wai Keung
Format Conference Proceeding
LanguageEnglish
Published IEEE 01.06.2021
Subjects
Computational modeling
Computer vision
Conferences
Feature extraction
Industries
Pattern recognition
Training
Online AccessGet full text

Cover

More Information
Summary:The goal of this paper is to model the fashion compatibility of an outfit and provide the explanations. We first extract features of all attributes of all items via convolutional neural networks, and then train the bidirectional Long Short-term Memory (Bi-LSTM) model to learn the compatibility of an outfit by treating these attribute features as a sequence. Gradient penalty regularization is exploited for training inter-factor compatibility net which is used to compute the loss for judgment and provide its explanation which is generated from the recognized reasons related to the judgment. To train and evaluate the proposed approach, we expanded the EVALUATION3 dataset in terms of the number of items and attributes. Experiment results show that our approach can successfully evaluate compatibility with reason.
ISSN:2160-7516
DOI:10.1109/CVPRW53098.2021.00432