Reusing GEMM Hardware for Efficient Execution of Depthwise Separable Convolution on ASIC-Based DNN Accelerators

• Published in: 2023 28th Asia and South Pacific Design Automation Conference (ASP-DAC) pp. 475 - 482
• Main Authors: Manasi, Susmita Dey, Banerjee, Suvadeep, Davare, Abhijit, Sorokin, Anton A., Burns, Steven M., Kirkpatrick, Desmond A., Sapatnekar, Sachin S.
• Format: Conference Proceeding
• Language: English
• Published: New York, NY, USA ACM 16.01.2023
• Series: ACM Conferences
• Subjects: Asia; CCS CONCEPTS Hardware → Application specific integrated circuits; Computing methodologies > Machine learning > Machine learning approaches > Neural networks; Computing methodologies → Neural networks; Convolution; Deep learning; deep learning accelerator; depthwise convolution; Design automation; Graphics processing units; Hardware; Hardware > Very large scale integration design > Application-specific VLSI designs > Application specific integrated circuits; lightweight CNN; Performance gain; depthwise convolution; lightweight CNN; deep learning accelerator

Deep learning (DL) accelerators are optimized for standard convolution. However, lightweight convolutional neural networks (CNNs) use depthwise convolution (DwC) in key layers, and the structural difference between DwC and standard convolution leads to significant performance bottleneck in executing...