Compressing Deep CNNs Using Basis Representation and Spectral Fine-Tuning

• Published in: 2021 IEEE International Conference on Image Processing (ICIP) pp. 3537 - 3541
• Main Authors: Tayyab, Muhammad, Khan, Fahad Ahmad, Mahalanobis, Abhijit
• Format: Conference Proceeding
• Language: English
• Published: IEEE 19.09.2021
• Subjects: Basis representation; Conferences; Convolution; Convolutional neural networks; Image classification; Image coding; network compression; Object detection; orthogonal filters; Spatial filters

We propose an efficient and straightforward method for compressing deep convolutional neural networks (CNNs) that uses basis filters to represent the convolutional layers, and optimizes the performance of the compressed network directly in the basis space. Specifically, any spatial convolution layer...