Quantification of the transferability of features between deep neural networks

• Published in: Procedia computer science Vol. 192; pp. 138 - 147
• Main Authors: Orhand, Romain, Khodji, Hiba, Hutt, Amarin, Jeannin-Girardon, Anne
• Format: Journal Article
• Language: English
• Published: Elsevier B.V 2021
• Subjects: convolutional neural networks; deep learning; feature transferability quantification; transfer learning; transfer learning; deep learning; convolutional neural networks; feature transferability quantification
• ISSN: 1877-0509; 1877-0509
• DOI: 10.1016/j.procs.2021.08.015

The computationally expensive nature of Deep Neural Networks, along with their significant hunger for labeled data, can impair the overall performance of these models. Among other techniques, this challenge can be tackled by Transfer Learning, which consists in re-using the knowledge previously learned by a model: this method is widely used and has proven effective in enhancing the performance of models in low resources contexts. However, there are relatively few contributions regarding the actual transferability of features in a deep learning model. This paper presents QUANTA (QUANtitative TrAnsferability), a method for quantifying the transferability of features of a given model. A QUANTA is a 2-parameters layer added in a target model at the level at which one wants to study the transferability of the corresponding layer in a source model. Data from the target domain being fed to both the source and the target models, the parameters of the QUANTA layer are trained in such a way that a mutually exclusive quantification occurs between the source model (trained and frozen) and the (trainable) target model. The proposed approach is evaluated on a set of experiments on a visual recognition task using Convolutional Neural Networks. The results show that QUANTA is a promising tool for quantifying the transferability of features of a source model, as well as a new way of assessing the quality of a transfer.