High-throughput systolic array-based accelerator for hybrid transformer-CNN networks

• Published in: Journal of King Saud University. Computer and information sciences Vol. 36; no. 8; p. 102194
• Main Authors: Song, Qingzeng, Dai, Yao, Lu, Hao, Jin, Guanghao
• Format: Journal Article
• Language: English
• Published: Elsevier B.V 01.10.2024; Elsevier
• Subjects: FPGA; Hardware accelerator; Hybrid transformer-CNN; Systolic array; Systolic array; Hardware accelerator; Hybrid transformer-CNN; FPGA

In this era of Transformers enjoying remarkable success, Convolutional Neural Networks (CNNs) remain highly relevant and useful. Indeed, hybrid Transformer-CNN network architectures, which combine the benefits of both approaches, have achieved impressive results. Vision Transformer (ViT) is a signif...