Beyond Self-Attention: External Attention Using Two Linear Layers for Visual Tasks - Guo, Meng-Hao; Liu, Zheng-Ning; Mu, Tai-Jiang; Hu, Shi-Min (IEEE transactions on pattern analysis and machine intelligence, 2023)
Keywords: Attention; Complexity; computer vision; deep learning; Image classification; Image processing; Image segmentation; multi-layer perceptrons; Object recognition; Semantic segmentation; transformer; Visual tasks